Note: This is test shard 1 of 3.
[==========] Running 2 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 2 tests from CatalogManagerConfigurations/MasterStressTest
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/0
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 19:26:31.632182 7747 test_util.cc:268] Using random seed: -1869583637
2026-08-12T19:26:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T19:26:31Z Disabled control of system clock
I20260812 19:26:31.699291 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.254:33521
--webserver_interface=127.7.144.254
--webserver_port=0
--builtin_ntp_servers=127.7.144.212:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 19:26:32.016032 7758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:26:32.016700 7758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:26:32.017096 7758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:26:32.048204 7758 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:26:32.048548 7758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:26:32.048815 7758 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:26:32.049089 7758 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:26:32.084352 7758 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.254:33521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.144.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:26:32.085572 7758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:26:32.087141 7758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:32.104547 7764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:32.104681 7767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:32.104944 7765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:32.106200 7758 server_base.cc:1034] running on GCE node
I20260812 19:26:33.302011 7758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:26:33.304817 7758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:26:33.306238 7758 hybrid_clock.cc:648] HybridClock initialized: now 1786562793306235 us; error 102 us; skew 500 ppm
I20260812 19:26:33.307135 7758 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:33.313731 7758 webserver.cc:460] Webserver started at http://127.7.144.254:41769/ using document root <none> and password file <none>
I20260812 19:26:33.314749 7758 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:33.315021 7758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:33.315541 7758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:33.320955 7758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data/instance:
uuid: "fa34b607af684984bbfb5cd60a2f058d"
format_stamp: "Formatted at 2026-08-12 19:26:33 on dist-test-slave-0b58"
I20260812 19:26:33.322239 7758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/wal/instance:
uuid: "fa34b607af684984bbfb5cd60a2f058d"
format_stamp: "Formatted at 2026-08-12 19:26:33 on dist-test-slave-0b58"
I20260812 19:26:33.330039 7758 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260812 19:26:33.336138 7775 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:33.337364 7758 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260812 19:26:33.337728 7758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/wal
uuid: "fa34b607af684984bbfb5cd60a2f058d"
format_stamp: "Formatted at 2026-08-12 19:26:33 on dist-test-slave-0b58"
I20260812 19:26:33.338107 7758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:33.373771 7758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:26:33.375476 7758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:26:33.375995 7758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:33.465253 7758 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.254:33521
I20260812 19:26:33.465363 7830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.254:33521 every 8 connection(s)
I20260812 19:26:33.468060 7758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/data/info.pb
I20260812 19:26:33.471273 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 7758
I20260812 19:26:33.471875 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-0/wal/instance
I20260812 19:26:33.475255 7832 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:33.477782 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.253:41563
--webserver_interface=127.7.144.253
--webserver_port=0
--builtin_ntp_servers=127.7.144.212:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 19:26:33.491150 7832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:26:33.524319 7832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } has no permanent_uuid. Determining permanent_uuid...
W20260812 19:26:33.526731 7777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
W20260812 19:26:33.531044 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:41563: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:26:33.580646 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } attempt: 1
W20260812 19:26:33.584822 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:41563: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:26:33.653366 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } attempt: 2
W20260812 19:26:33.657505 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:41563: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:26:33.748955 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } attempt: 3
W20260812 19:26:33.752978 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:41563: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
W20260812 19:26:33.811331 7834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:26:33.811911 7834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:26:33.812419 7834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:26:33.844509 7834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:26:33.844800 7834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:26:33.845000 7834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:26:33.845198 7834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:26:33.881661 7834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.253:41563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.144.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:26:33.882941 7834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:26:33.884589 7834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 19:26:33.896471 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } attempt: 4
W20260812 19:26:33.901849 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:41563: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
W20260812 19:26:33.902935 7844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:34.201344 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } attempt: 5
W20260812 19:26:34.205972 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:41563: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:26:34.753520 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } attempt: 6
W20260812 19:26:34.763029 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:41563: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
W20260812 19:26:33.903265 7843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:33.904160 7846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:33.906435 7834 server_base.cc:1034] running on GCE node
I20260812 19:26:35.108539 7834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:26:35.111215 7834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:26:35.112592 7834 hybrid_clock.cc:648] HybridClock initialized: now 1786562795112543 us; error 59 us; skew 500 ppm
I20260812 19:26:35.113444 7834 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:35.124673 7834 webserver.cc:460] Webserver started at http://127.7.144.253:39161/ using document root <none> and password file <none>
I20260812 19:26:35.125651 7834 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:35.125857 7834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:35.126312 7834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:35.131385 7834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/instance:
uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
format_stamp: "Formatted at 2026-08-12 19:26:35 on dist-test-slave-0b58"
I20260812 19:26:35.132619 7834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal/instance:
uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
format_stamp: "Formatted at 2026-08-12 19:26:35 on dist-test-slave-0b58"
I20260812 19:26:35.140445 7834 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260812 19:26:35.146368 7857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:35.147517 7834 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 19:26:35.147809 7834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
format_stamp: "Formatted at 2026-08-12 19:26:35 on dist-test-slave-0b58"
I20260812 19:26:35.148132 7834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:35.189666 7834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:26:35.191138 7834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:26:35.191567 7834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:35.268046 7834 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.253:41563
I20260812 19:26:35.268242 7912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.253:41563 every 8 connection(s)
I20260812 19:26:35.270849 7834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
I20260812 19:26:35.272127 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 7834
I20260812 19:26:35.272625 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal/instance
I20260812 19:26:35.275754 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:46815
--webserver_interface=127.7.144.252
--webserver_port=0
--builtin_ntp_servers=127.7.144.212:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 19:26:35.277420 7913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:35.289248 7913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:26:35.313606 7913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:26:35.330457 7913 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } has no permanent_uuid. Determining permanent_uuid...
W20260812 19:26:35.332849 7861 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
W20260812 19:26:35.337628 7913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:35.387247 7913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 1
W20260812 19:26:35.391374 7913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:35.459903 7913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 2
W20260812 19:26:35.463876 7913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:35.555333 7913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 3
W20260812 19:26:35.559605 7913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
W20260812 19:26:35.611917 7915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:26:35.612599 7915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:26:35.613088 7915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:26:35.645037 7915 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:26:35.645351 7915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:26:35.645686 7915 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:26:35.645946 7915 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:26:35.682108 7915 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:46815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.144.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:26:35.683485 7915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:26:35.685195 7915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 19:26:35.703269 7913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 4
W20260812 19:26:35.706280 7930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:35.708766 7913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:35.823534 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } attempt: 7
I20260812 19:26:35.841061 7832 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } has no permanent_uuid. Determining permanent_uuid...
W20260812 19:26:35.849020 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:35.907532 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 1
W20260812 19:26:35.913105 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:35.994752 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 2
W20260812 19:26:35.999632 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:36.008383 7913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 5
W20260812 19:26:36.013299 7913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:36.085153 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 3
W20260812 19:26:36.090171 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:36.230635 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 4
W20260812 19:26:36.235126 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:36.518646 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 5
W20260812 19:26:36.523226 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:36.560781 7913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 6
W20260812 19:26:36.569249 7913 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
W20260812 19:26:35.706528 7926 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:35.707073 7932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:35.708910 7915 server_base.cc:1034] running on GCE node
I20260812 19:26:36.929176 7915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:26:36.931828 7915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:26:36.933252 7915 hybrid_clock.cc:648] HybridClock initialized: now 1786562796933232 us; error 59 us; skew 500 ppm
I20260812 19:26:36.934161 7915 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:36.941104 7915 webserver.cc:460] Webserver started at http://127.7.144.252:43951/ using document root <none> and password file <none>
I20260812 19:26:36.942062 7915 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:36.942327 7915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:36.943035 7915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:36.948292 7915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data/instance:
uuid: "b99a815f68ee4d93b167a67778a3e1a6"
format_stamp: "Formatted at 2026-08-12 19:26:36 on dist-test-slave-0b58"
I20260812 19:26:36.949525 7915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/wal/instance:
uuid: "b99a815f68ee4d93b167a67778a3e1a6"
format_stamp: "Formatted at 2026-08-12 19:26:36 on dist-test-slave-0b58"
I20260812 19:26:36.956955 7915 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.002s sys 0.005s
I20260812 19:26:36.962867 7944 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:36.964017 7915 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 19:26:36.964391 7915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/wal
uuid: "b99a815f68ee4d93b167a67778a3e1a6"
format_stamp: "Formatted at 2026-08-12 19:26:36 on dist-test-slave-0b58"
I20260812 19:26:36.964798 7915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:37.004194 7915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:26:37.005822 7915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:26:37.006338 7915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:37.075656 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 6
W20260812 19:26:37.083071 7832 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:46815: Network error: Client connection negotiation failed: client connection to 127.7.144.252:46815: connect: Connection refused (error 111)
I20260812 19:26:37.083424 7915 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.252:46815
I20260812 19:26:37.083557 7999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.252:46815 every 8 connection(s)
I20260812 19:26:37.086410 7915 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
I20260812 19:26:37.090381 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 7915
I20260812 19:26:37.090957 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-2/wal/instance
I20260812 19:26:37.092561 8000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:37.110260 8000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:26:37.136889 8000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:26:37.151180 8000 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:26:37.170310 8000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Bootstrap starting.
I20260812 19:26:37.176934 8000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:37.179420 8000 log.cc:824] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Log is configured to *not* fsync() on all Append() calls
I20260812 19:26:37.184244 8000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: No bootstrap required, opened a new log
I20260812 19:26:37.207041 8000 raft_consensus.cc:348] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:37.208041 8000 raft_consensus.cc:374] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:37.208385 8000 raft_consensus.cc:729] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b99a815f68ee4d93b167a67778a3e1a6, State: Initialized, Role: FOLLOWER
I20260812 19:26:37.209321 8000 consensus_queue.cc:260] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:37.211817 8011 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:37.212507 8011 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:26:37.213295 8000 sys_catalog.cc:564] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 19:26:37.239374 8024 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:26:37.239666 8024 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:26:37.261597 7950 tablet.cc:2369] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:26:37.237142 7915 master_runner.cc:186] Error getting master registration for 127.7.144.254:33521: OK, instance_id { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" instance_seqno: 1786562793441560 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 19:26:37.271039 7915 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:26:37.307219 8011 raft_consensus.cc:482] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:37.307698 8011 raft_consensus.cc:504] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:37.309959 8011 leader_election.cc:288] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563)
I20260812 19:26:37.629683 7913 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 7
I20260812 19:26:37.654053 7913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Bootstrap starting.
I20260812 19:26:37.663393 7913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:37.665832 7913 log.cc:824] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Log is configured to *not* fsync() on all Append() calls
I20260812 19:26:37.671610 7913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: No bootstrap required, opened a new log
I20260812 19:26:37.703053 7913 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:37.703954 7913 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:37.704298 7913 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9a660a0f1e4fc6bc6335b38eece0bd, State: Initialized, Role: FOLLOWER
I20260812 19:26:37.705258 7913 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:37.709275 8028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:37.710795 7913 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:26:37.710956 8028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:26:37.711000 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:26:37.712095 7886 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 0.
I20260812 19:26:37.713933 7945 leader_election.cc:302] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6; no voters:
I20260812 19:26:37.715124 8011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:37.715505 8011 raft_consensus.cc:482] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:37.715965 8011 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:37.726182 8011 raft_consensus.cc:504] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:37.740353 8011 leader_election.cc:288] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 1 election: Requested vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563)
I20260812 19:26:37.740535 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
I20260812 19:26:37.741122 7886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:37.747855 7886 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 1.
I20260812 19:26:37.749187 7945 leader_election.cc:302] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6; no voters:
I20260812 19:26:37.750372 8011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 19:26:37.759922 8039 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:26:37.760416 8039 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:26:37.763017 8011 raft_consensus.cc:686] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 1 LEADER]: Becoming Leader. State: Replica: b99a815f68ee4d93b167a67778a3e1a6, State: Running, Role: LEADER
I20260812 19:26:37.764797 8011 consensus_queue.cc:237] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:37.739934 7834 master_runner.cc:186] Error getting master registration for 127.7.144.254:33521: OK, instance_id { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" instance_seqno: 1786562793441560 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 19:26:37.775923 7834 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:26:37.793762 8042 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:37.794605 8042 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
I20260812 19:26:37.798457 8045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:26:37.805905 8045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:26:37.825758 7886 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Refusing update from remote peer b99a815f68ee4d93b167a67778a3e1a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:26:37.827725 8011 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:37.860986 8028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:37.862035 8028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:26:37.872470 8045 catalog_manager.cc:1347] Generated new cluster ID: 659155adda434886ba3c3e41d37f31b5
I20260812 19:26:37.872773 8045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:26:37.879127 8042 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:37.880127 8042 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
I20260812 19:26:37.889784 8028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:37.890537 8028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:26:37.926440 8045 catalog_manager.cc:1370] Generated new certificate authority record
I20260812 19:26:37.930572 8045 catalog_manager.cc:1504] Loading token signing keys...
W20260812 19:26:37.938282 7948 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.254:33521 timed out after 0.627s (SENT)
I20260812 19:26:37.975829 8045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Generated new TSK 0
I20260812 19:26:37.983515 8045 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:26:38.015741 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.144.193:0
--local_ip_for_outbound_sockets=127.7.144.193
--webserver_interface=127.7.144.193
--webserver_port=0
--tserver_master_addrs=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--builtin_ntp_servers=127.7.144.212:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 19:26:38.116540 7832 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } attempt: 7
I20260812 19:26:38.176935 7832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: Bootstrap starting.
I20260812 19:26:38.198923 7832 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:38.201598 7832 log.cc:824] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: Log is configured to *not* fsync() on all Append() calls
I20260812 19:26:38.218077 7832 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: No bootstrap required, opened a new log
I20260812 19:26:38.341384 7832 raft_consensus.cc:348] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:38.342289 7832 raft_consensus.cc:374] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:38.342583 7832 raft_consensus.cc:729] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa34b607af684984bbfb5cd60a2f058d, State: Initialized, Role: FOLLOWER
I20260812 19:26:38.343509 7832 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:38.357482 8056 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:38.358486 8056 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:26:38.362818 7832 sys_catalog.cc:564] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:26:38.363260 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d"
I20260812 19:26:38.364244 7802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:38.367326 7805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d"
I20260812 19:26:38.368522 7803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:38.368974 7806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
W20260812 19:26:38.371585 7806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 2) took 1061 ms (client timeout 627 ms). Trace:
W20260812 19:26:38.371948 7806 rpcz_store.cc:269] 0812 19:26:37.310528 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:37.310724 (+ 196us) service_pool.cc:227] Handling call
0812 19:26:38.371527 (+1060803us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:26:38.370182 7805 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43044 (request call id 3) took 631 ms (client timeout 600 ms). Trace:
W20260812 19:26:38.373203 7805 rpcz_store.cc:269] 0812 19:26:37.738701 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:37.739031 (+ 330us) service_pool.cc:227] Handling call
0812 19:26:38.370104 (+631073us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:26:38.379823 7802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 1.
I20260812 19:26:38.381753 7804 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Refusing update from remote peer b99a815f68ee4d93b167a67778a3e1a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260812 19:26:38.387435 7783 tablet.cc:2369] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:26:38.393363 8011 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:38.492035 8067 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:38.500911 8056 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:38.501617 8067 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:26:38.501674 8056 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:26:38.508613 8075 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:38.509313 8075 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:38.512708 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:38.517359 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:38.519325 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:38.524935 8078 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:38.535200 8075 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:38.564831 8076 catalog_manager.cc:1259] Loaded cluster ID: 659155adda434886ba3c3e41d37f31b5
I20260812 19:26:38.565117 8076 catalog_manager.cc:1552] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: loading cluster ID for follower catalog manager: success
I20260812 19:26:38.576825 8076 catalog_manager.cc:1574] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: acquiring CA information for follower catalog manager: success
I20260812 19:26:38.582621 8076 catalog_manager.cc:1602] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260812 19:26:38.725654 8053 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:26:38.726403 8053 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:26:38.727382 8053 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 19:26:38.766283 8039 catalog_manager.cc:1259] Loaded cluster ID: 659155adda434886ba3c3e41d37f31b5
I20260812 19:26:38.766716 8039 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: loading cluster ID for follower catalog manager: success
I20260812 19:26:38.774698 8039 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: acquiring CA information for follower catalog manager: success
W20260812 19:26:38.784992 8053 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:26:38.786676 8053 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.144.193
I20260812 19:26:38.790263 8039 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 19:26:38.853674 8053 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.144.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.144.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.144.193
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:26:38.855326 8053 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:26:38.857553 8053 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 19:26:38.898293 8056 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:38.898846 8056 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:38.901298 8056 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:38.904693 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:38.903625 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:26:38.909255 7777 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:26:38.910524 8056 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:38.944238 8088 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:38.946764 8088 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
W20260812 19:26:38.949658 8086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:39.084969 8097 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:39.085716 8097 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:39.088757 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:39.089284 8097 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:39.089898 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:39.092245 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:39.093358 8097 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:39.918450 8098 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:39.919241 8098 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:39.933768 8098 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:39.938777 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:26:39.940274 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:39.942266 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:26:39.943347 8098 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:40.045267 8099 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:40.046063 8099 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:40.049063 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:40.049710 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:40.051293 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:40.056535 8099 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:40.058365 8099 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:38.952520 8091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:38.958879 8053 server_base.cc:1034] running on GCE node
W20260812 19:26:38.950730 8087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:40.547732 8053 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:26:40.550808 8053 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:26:40.552300 8053 hybrid_clock.cc:648] HybridClock initialized: now 1786562800552249 us; error 87 us; skew 500 ppm
I20260812 19:26:40.553144 8053 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:40.564911 8053 webserver.cc:460] Webserver started at http://127.7.144.193:43077/ using document root <none> and password file <none>
I20260812 19:26:40.565943 8053 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:40.566215 8053 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:40.566941 8053 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:40.572630 8053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data/instance:
uuid: "6a95b50ceede4dc99913aec28ddaa380"
format_stamp: "Formatted at 2026-08-12 19:26:40 on dist-test-slave-0b58"
I20260812 19:26:40.573894 8053 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/instance:
uuid: "6a95b50ceede4dc99913aec28ddaa380"
format_stamp: "Formatted at 2026-08-12 19:26:40 on dist-test-slave-0b58"
I20260812 19:26:40.581984 8053 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.004s
I20260812 19:26:40.589133 8106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:40.590556 8053 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260812 19:26:40.590926 8053 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal
uuid: "6a95b50ceede4dc99913aec28ddaa380"
format_stamp: "Formatted at 2026-08-12 19:26:40 on dist-test-slave-0b58"
I20260812 19:26:40.591316 8053 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:40.638578 8053 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:26:40.640120 8053 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:26:40.640686 8053 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:40.644037 8053 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:40.649490 8053 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:40.649740 8053 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:40.650044 8053 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:40.650224 8053 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:40.805677 8193 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:40.806478 8193 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:40.810667 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:26:40.815153 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:40.817410 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:26:40.823892 8193 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:40.825263 8193 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:40.914917 8053 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.193:46029
I20260812 19:26:40.915048 8241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.193:46029 every 8 connection(s)
I20260812 19:26:40.917862 8053 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/data/info.pb
I20260812 19:26:40.920516 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 8053
I20260812 19:26:40.921207 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/instance
I20260812 19:26:40.981669 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.144.194:0
--local_ip_for_outbound_sockets=127.7.144.194
--webserver_interface=127.7.144.194
--webserver_port=0
--tserver_master_addrs=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--builtin_ntp_servers=127.7.144.212:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 19:26:41.010810 8246 heartbeater.cc:347] Connected to a master server at 127.7.144.254:33521
I20260812 19:26:41.011324 8246 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:41.012552 8246 heartbeater.cc:511] Master 127.7.144.254:33521 requested a full tablet report, sending...
I20260812 19:26:41.016010 8243 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:26:41.016408 8243 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:41.017251 8243 heartbeater.cc:511] Master 127.7.144.253:41563 requested a full tablet report, sending...
I20260812 19:26:41.021140 7874 ts_manager.cc:194] Registered new tserver with Master: 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:41.022336 8242 heartbeater.cc:347] Connected to a master server at 127.7.144.252:46815
I20260812 19:26:41.022679 8242 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:41.023497 8242 heartbeater.cc:511] Master 127.7.144.252:46815 requested a full tablet report, sending...
I20260812 19:26:41.026330 7962 ts_manager.cc:194] Registered new tserver with Master: 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:41.016237 7795 ts_manager.cc:194] Registered new tserver with Master: 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:41.029184 7962 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.144.193:56723
I20260812 19:26:41.035916 8254 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:41.036576 8254 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:41.039762 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:41.040998 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:41.043169 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:41.048372 8254 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:41.049492 8254 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:41.430809 8253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:26:41.431313 8253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:26:41.431847 8253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:26:41.464066 8253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:26:41.465092 8253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.144.194
I20260812 19:26:41.502741 8253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.144.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.144.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.144.194
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:26:41.503928 8253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:26:41.505575 8253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:41.526060 8262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:41.535092 8242 heartbeater.cc:503] Master 127.7.144.252:46815 was elected leader, sending a full tablet report...
I20260812 19:26:41.645241 8268 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:41.645676 8268 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:41.647239 8268 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:41.648353 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:41.648514 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:41.650162 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:41.650872 8268 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:42.155958 8270 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:42.156474 8270 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:42.158288 8270 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:42.159647 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:42.160017 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:42.161574 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:42.162216 8270 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:42.269949 8271 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:42.270881 8271 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:42.274564 8271 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:42.275167 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:26:42.277240 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:42.278985 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:26:42.280365 8271 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:41.526760 8264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:41.526975 8261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:41.528228 8253 server_base.cc:1034] running on GCE node
I20260812 19:26:42.751914 8253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:26:42.754401 8253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:26:42.755843 8253 hybrid_clock.cc:648] HybridClock initialized: now 1786562802755826 us; error 59 us; skew 500 ppm
I20260812 19:26:42.756809 8253 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:42.758271 8273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:42.758817 8273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:42.760975 8273 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:42.762384 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:42.762444 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:42.764391 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:42.765836 8253 webserver.cc:460] Webserver started at http://127.7.144.194:43277/ using document root <none> and password file <none>
I20260812 19:26:42.765901 8273 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:42.767135 8253 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:42.767345 8253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:42.767931 8253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:42.773705 8253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data/instance:
uuid: "93aafc5b36824666a82aa55bc73df9e7"
format_stamp: "Formatted at 2026-08-12 19:26:42 on dist-test-slave-0b58"
I20260812 19:26:42.774984 8253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/instance:
uuid: "93aafc5b36824666a82aa55bc73df9e7"
format_stamp: "Formatted at 2026-08-12 19:26:42 on dist-test-slave-0b58"
I20260812 19:26:42.784925 8253 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.010s sys 0.001s
I20260812 19:26:42.792099 8277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:42.793359 8253 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260812 19:26:42.793731 8253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal
uuid: "93aafc5b36824666a82aa55bc73df9e7"
format_stamp: "Formatted at 2026-08-12 19:26:42 on dist-test-slave-0b58"
I20260812 19:26:42.794122 8253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:42.873742 8253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:26:42.875379 8253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:26:42.875898 8253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:42.878750 8253 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:42.883244 8253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:42.883482 8253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:42.883826 8253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:42.884001 8253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:43.040530 8253 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.194:44609
I20260812 19:26:43.040663 8408 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.194:44609 every 8 connection(s)
I20260812 19:26:43.043390 8253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/data/info.pb
I20260812 19:26:43.052510 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 8253
I20260812 19:26:43.053377 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/instance
I20260812 19:26:43.066588 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.144.195:0
--local_ip_for_outbound_sockets=127.7.144.195
--webserver_interface=127.7.144.195
--webserver_port=0
--tserver_master_addrs=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--builtin_ntp_servers=127.7.144.212:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 19:26:43.104393 8409 heartbeater.cc:347] Connected to a master server at 127.7.144.252:46815
I20260812 19:26:43.104960 8409 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:43.106447 8409 heartbeater.cc:511] Master 127.7.144.252:46815 requested a full tablet report, sending...
I20260812 19:26:43.109403 7962 ts_manager.cc:194] Registered new tserver with Master: 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:43.109658 8411 heartbeater.cc:347] Connected to a master server at 127.7.144.254:33521
I20260812 19:26:43.110018 8411 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:43.110855 8411 heartbeater.cc:511] Master 127.7.144.254:33521 requested a full tablet report, sending...
I20260812 19:26:43.111712 7962 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.144.194:55939
I20260812 19:26:43.113984 7795 ts_manager.cc:194] Registered new tserver with Master: 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:43.114797 8410 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:26:43.115119 8410 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:43.116165 8410 heartbeater.cc:511] Master 127.7.144.253:41563 requested a full tablet report, sending...
I20260812 19:26:43.118816 7874 ts_manager.cc:194] Registered new tserver with Master: 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:43.266645 8422 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:43.267143 8422 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:43.269424 8422 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:43.269915 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:26:43.270779 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:43.272161 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:26:43.272929 8422 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:43.421654 8417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:26:43.422267 8417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:26:43.422827 8417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:26:43.454169 8417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:26:43.455119 8417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.144.195
I20260812 19:26:43.492043 8417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.144.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.144.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.144.195
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:26:43.493432 8417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:26:43.495100 8417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:26:43.515513 8431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:26:43.618285 8409 heartbeater.cc:503] Master 127.7.144.252:46815 was elected leader, sending a full tablet report...
I20260812 19:26:44.249841 8435 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:44.250439 8435 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:44.253132 8435 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:44.254648 7886 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:26:44.254891 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:44.257567 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:26:44.258631 8435 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:44.715274 8436 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:26:44.715764 8436 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:26:44.717443 8436 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:26:44.718336 7804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:26:44.718571 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:26:44.719949 7861 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:26:44.720623 8436 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:43.515743 8428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:43.516355 8429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:44.773080 8430 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260812 19:26:44.773195 8417 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260812 19:26:44.777407 8417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:26:44.779603 8417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:26:44.780961 8417 hybrid_clock.cc:648] HybridClock initialized: now 1786562804780932 us; error 48 us; skew 500 ppm
I20260812 19:26:44.781840 8417 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:26:44.788472 8417 webserver.cc:460] Webserver started at http://127.7.144.195:39175/ using document root <none> and password file <none>
I20260812 19:26:44.789431 8417 fs_manager.cc:359] Metadata directory not provided
I20260812 19:26:44.789666 8417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:26:44.790132 8417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:26:44.795039 8417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data/instance:
uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
format_stamp: "Formatted at 2026-08-12 19:26:44 on dist-test-slave-0b58"
I20260812 19:26:44.796196 8417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/instance:
uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
format_stamp: "Formatted at 2026-08-12 19:26:44 on dist-test-slave-0b58"
I20260812 19:26:44.803548 8417 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260812 19:26:44.809988 8441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:44.811266 8417 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.003s
I20260812 19:26:44.811560 8417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal
uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
format_stamp: "Formatted at 2026-08-12 19:26:44 on dist-test-slave-0b58"
I20260812 19:26:44.811973 8417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:26:44.852855 8417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:26:44.854375 8417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:26:44.854842 8417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:26:44.857436 8417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:26:44.861940 8417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:26:44.862166 8417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:44.862438 8417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:26:44.862596 8417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 19:26:45.013284 8417 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.195:33171
I20260812 19:26:45.013407 8566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.195:33171 every 8 connection(s)
I20260812 19:26:45.015965 8417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/data/info.pb
I20260812 19:26:45.023337 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 8417
I20260812 19:26:45.023959 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/instance
I20260812 19:26:45.090569 8569 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:26:45.091100 8569 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:45.092451 8569 heartbeater.cc:511] Master 127.7.144.253:41563 requested a full tablet report, sending...
I20260812 19:26:45.094419 8567 heartbeater.cc:347] Connected to a master server at 127.7.144.252:46815
I20260812 19:26:45.094790 8567 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:45.095638 8567 heartbeater.cc:511] Master 127.7.144.252:46815 requested a full tablet report, sending...
I20260812 19:26:45.095582 7874 ts_manager.cc:194] Registered new tserver with Master: 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:45.098016 8570 heartbeater.cc:347] Connected to a master server at 127.7.144.254:33521
I20260812 19:26:45.098297 7962 ts_manager.cc:194] Registered new tserver with Master: 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:45.098378 8570 heartbeater.cc:464] Registering TS with master...
I20260812 19:26:45.099200 8570 heartbeater.cc:511] Master 127.7.144.254:33521 requested a full tablet report, sending...
I20260812 19:26:45.099879 7962 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.144.195:34285
I20260812 19:26:45.102098 7795 ts_manager.cc:194] Registered new tserver with Master: 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:45.121510 7747 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 19:26:45.180349 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d2b76284c93f4e70ba5dd9ae73dce961"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:45.180325 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d20cc2c9314049baabdf4a1593ad048a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:45.180330 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_59250f0e7bd54e8db08871c5c58be74c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:45.183007 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_b5b633ce61c54d7fab68c049997c9490"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:45.184182 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d2b76284c93f4e70ba5dd9ae73dce961 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:45.184940 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d20cc2c9314049baabdf4a1593ad048a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:45.185334 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5b633ce61c54d7fab68c049997c9490 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:45.184204 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_59250f0e7bd54e8db08871c5c58be74c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:45.224445 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 7834
W20260812 19:26:45.261807 7945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.7.144.253:41563 (error 108) [suppressed 1 similar messages]
I20260812 19:26:45.286065 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d20cc2c9314049baabdf4a1593ad048a" } new_table_name: "default.Table_ca6137a5cdef4d60bd7bea0ba15a60fe" modify_external_catalogs: true
I20260812 19:26:45.286178 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_59250f0e7bd54e8db08871c5c58be74c" } new_table_name: "default.Table_b3e38eb99bf24e2f9c3999ea4fa55d09" modify_external_catalogs: true
W20260812 19:26:45.334417 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac608059319748a1b34510267c813f47 has no consensus state
W20260812 19:26:45.335896 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb970cb3852940129aaefdc2208cf74d consensus state has no leader
W20260812 19:26:45.338451 7945 consensus_peers.cc:487] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 -> Peer 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563): Couldn't send request to peer 1e9a660a0f1e4fc6bc6335b38eece0bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:45.340086 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d2b76284c93f4e70ba5dd9ae73dce961" } modify_external_catalogs: true
I20260812 19:26:45.340858 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d2b76284c93f4e70ba5dd9ae73dce961" } modify_external_catalogs: true
I20260812 19:26:45.344310 7959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_b5b633ce61c54d7fab68c049997c9490" } modify_external_catalogs: true
I20260812 19:26:45.344856 7959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_b5b633ce61c54d7fab68c049997c9490" } modify_external_catalogs: true
I20260812 19:26:45.354768 8158 tablet_service.cc:1467] Processing CreateTablet for tablet fb970cb3852940129aaefdc2208cf74d (DEFAULT_TABLE table=default.Table_d20cc2c9314049baabdf4a1593ad048a [id=8babc41fda134da8987a2060959eed16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.357182 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb970cb3852940129aaefdc2208cf74d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:45.390005 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet fb970cb3852940129aaefdc2208cf74d (table default.Table_ca6137a5cdef4d60bd7bea0ba15a60fe [id=8babc41fda134da8987a2060959eed16], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fb970cb3852940129aaefdc2208cf74d consensus state has no leader
I20260812 19:26:45.390712 8495 tablet_service.cc:1467] Processing CreateTablet for tablet fb970cb3852940129aaefdc2208cf74d (DEFAULT_TABLE table=default.Table_d20cc2c9314049baabdf4a1593ad048a [id=8babc41fda134da8987a2060959eed16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.392855 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb970cb3852940129aaefdc2208cf74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.393755 8333 tablet_service.cc:1467] Processing CreateTablet for tablet fb970cb3852940129aaefdc2208cf74d (DEFAULT_TABLE table=default.Table_d20cc2c9314049baabdf4a1593ad048a [id=8babc41fda134da8987a2060959eed16]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.395714 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb970cb3852940129aaefdc2208cf74d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.398029 8157 tablet_service.cc:1467] Processing CreateTablet for tablet cf0c7c0145764cf8bd28de06f0465efa (DEFAULT_TABLE table=default.Table_b5b633ce61c54d7fab68c049997c9490 [id=065b125b4f0844198044142564365015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.399204 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0c7c0145764cf8bd28de06f0465efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.400622 8332 tablet_service.cc:1467] Processing CreateTablet for tablet cf0c7c0145764cf8bd28de06f0465efa (DEFAULT_TABLE table=default.Table_b5b633ce61c54d7fab68c049997c9490 [id=065b125b4f0844198044142564365015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.401830 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0c7c0145764cf8bd28de06f0465efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.404815 7959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet cf0c7c0145764cf8bd28de06f0465efa
I20260812 19:26:45.406766 8494 tablet_service.cc:1467] Processing CreateTablet for tablet cf0c7c0145764cf8bd28de06f0465efa (DEFAULT_TABLE table=default.Table_b5b633ce61c54d7fab68c049997c9490 [id=065b125b4f0844198044142564365015]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.407239 8493 tablet_service.cc:1467] Processing CreateTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 (DEFAULT_TABLE table=default.Table_d2b76284c93f4e70ba5dd9ae73dce961 [id=07fc51bc81d848acbe4dff6fb6605ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.408118 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf0c7c0145764cf8bd28de06f0465efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.410377 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3cdba0279f747f68ad2cd5e4454da92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.410028 8156 tablet_service.cc:1467] Processing CreateTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 (DEFAULT_TABLE table=default.Table_d2b76284c93f4e70ba5dd9ae73dce961 [id=07fc51bc81d848acbe4dff6fb6605ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.410360 8330 tablet_service.cc:1467] Processing CreateTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 (DEFAULT_TABLE table=default.Table_d2b76284c93f4e70ba5dd9ae73dce961 [id=07fc51bc81d848acbe4dff6fb6605ca6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.411336 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3cdba0279f747f68ad2cd5e4454da92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.411608 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3cdba0279f747f68ad2cd5e4454da92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.413291 8155 tablet_service.cc:1467] Processing CreateTablet for tablet ac608059319748a1b34510267c813f47 (DEFAULT_TABLE table=default.Table_b3e38eb99bf24e2f9c3999ea4fa55d09 [id=027ee2c03b3e4d699438a0d9ee82ff12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.413748 8329 tablet_service.cc:1467] Processing CreateTablet for tablet ac608059319748a1b34510267c813f47 (DEFAULT_TABLE table=default.Table_b3e38eb99bf24e2f9c3999ea4fa55d09 [id=027ee2c03b3e4d699438a0d9ee82ff12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.414449 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac608059319748a1b34510267c813f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.414969 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac608059319748a1b34510267c813f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.417117 8492 tablet_service.cc:1467] Processing CreateTablet for tablet ac608059319748a1b34510267c813f47 (DEFAULT_TABLE table=default.Table_b3e38eb99bf24e2f9c3999ea4fa55d09 [id=027ee2c03b3e4d699438a0d9ee82ff12]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.418334 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac608059319748a1b34510267c813f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.414458 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0c7c0145764cf8bd28de06f0465efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:45.420632 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0c7c0145764cf8bd28de06f0465efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:45.430678 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet a3cdba0279f747f68ad2cd5e4454da92
I20260812 19:26:45.433557 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:45.435308 8153 tablet_service.cc:1514] Processing DeleteTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:45.438726 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet cf0c7c0145764cf8bd28de06f0465efa because the tablet was not found. No further retry: Not found: Tablet not found: cf0c7c0145764cf8bd28de06f0465efa
W20260812 19:26:45.441568 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet a3cdba0279f747f68ad2cd5e4454da92 because the tablet was not found. No further retry: Not found: Tablet not found: a3cdba0279f747f68ad2cd5e4454da92
I20260812 19:26:45.425060 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0c7c0145764cf8bd28de06f0465efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:45.440711 8490 tablet_service.cc:1514] Processing DeleteTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:45.470768 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_2d1f3cf019494f3ba9e1aa5492599638"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:45.473881 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2d1f3cf019494f3ba9e1aa5492599638 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:45.484637 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_f8ddd255d758494fb731ca72c5992730"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:45.486398 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f8ddd255d758494fb731ca72c5992730 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:45.495698 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet cf0c7c0145764cf8bd28de06f0465efa because the tablet was not found. No further retry: Not found: Tablet not found: cf0c7c0145764cf8bd28de06f0465efa
W20260812 19:26:45.496520 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet a3cdba0279f747f68ad2cd5e4454da92 because the tablet was not found. No further retry: Not found: Tablet not found: a3cdba0279f747f68ad2cd5e4454da92
I20260812 19:26:45.513270 8627 tablet_bootstrap.cc:492] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:45.541107 8627 tablet_bootstrap.cc:654] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:45.573374 8627 log.cc:824] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Log is configured to *not* fsync() on all Append() calls
I20260812 19:26:45.573523 7962 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ca6137a5cdef4d60bd7bea0ba15a60fe" } new_table_name: "default.Table_352f3e372ef2499faa65351a421cb72b" modify_external_catalogs: true
I20260812 19:26:45.577564 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_73aa9e100b6f4d8c9a6c1a473d710e6d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:45.581737 7957 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_b3e38eb99bf24e2f9c3999ea4fa55d09" } new_table_name: "default.Table_e0736121494346cc84c7333ef09a8697" modify_external_catalogs: true
W20260812 19:26:45.583604 8243 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:41563 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:26:45.588521 8627 tablet_bootstrap.cc:492] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:45.589035 8627 ts_tablet_manager.cc:1397] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.078s user 0.013s sys 0.008s
I20260812 19:26:45.588294 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_6b4776007c0e48899ab8511dd1c578f1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:45.590875 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b4776007c0e48899ab8511dd1c578f1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:45.580121 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_73aa9e100b6f4d8c9a6c1a473d710e6d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:45.605551 8567 heartbeater.cc:503] Master 127.7.144.252:46815 was elected leader, sending a full tablet report...
W20260812 19:26:45.623415 8569 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:41563 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:26:45.640395 8627 raft_consensus.cc:348] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:45.641464 8627 raft_consensus.cc:374] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:45.641925 8627 raft_consensus.cc:729] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:45.643196 8627 consensus_queue.cc:260] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:45.655223 8627 ts_tablet_manager.cc:1428] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.066s user 0.037s sys 0.009s
I20260812 19:26:45.658507 8627 tablet_bootstrap.cc:492] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:45.665004 8623 tablet_bootstrap.cc:492] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:45.666283 8627 tablet_bootstrap.cc:654] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:45.674642 8410 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:41563 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:26:45.686847 7956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_f8ddd255d758494fb731ca72c5992730" } modify_external_catalogs: true
W20260812 19:26:45.687426 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet cf0c7c0145764cf8bd28de06f0465efa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0c7c0145764cf8bd28de06f0465efa already in progress: creating tablet
I20260812 19:26:45.688201 7956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_f8ddd255d758494fb731ca72c5992730" } modify_external_catalogs: true
I20260812 19:26:45.686051 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2d1f3cf019494f3ba9e1aa5492599638" } modify_external_catalogs: true
W20260812 19:26:45.688937 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet a3cdba0279f747f68ad2cd5e4454da92 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a3cdba0279f747f68ad2cd5e4454da92 already in progress: creating tablet
I20260812 19:26:45.689719 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2d1f3cf019494f3ba9e1aa5492599638" } modify_external_catalogs: true
I20260812 19:26:45.690768 8627 tablet_bootstrap.cc:492] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:45.691218 8627 ts_tablet_manager.cc:1397] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.033s user 0.016s sys 0.000s
I20260812 19:26:45.693984 8627 raft_consensus.cc:348] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:45.694715 8627 raft_consensus.cc:374] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:45.694994 8627 raft_consensus.cc:729] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:45.695621 8627 consensus_queue.cc:260] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:45.700523 8627 ts_tablet_manager.cc:1428] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260812 19:26:45.714215 8636 tablet_bootstrap.cc:492] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:45.721056 8627 tablet_bootstrap.cc:492] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:45.728119 8627 tablet_bootstrap.cc:654] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:45.735445 8636 tablet_bootstrap.cc:654] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:45.741961 8636 log.cc:824] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Log is configured to *not* fsync() on all Append() calls
W20260812 19:26:45.797405 7957 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ac608059319748a1b34510267c813f47 consensus state has no leader
I20260812 19:26:45.800107 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_950444052d854c34a6f03fe473988bff"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:45.802656 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_950444052d854c34a6f03fe473988bff in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:45.817998 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet fb970cb3852940129aaefdc2208cf74d (table default.Table_ca6137a5cdef4d60bd7bea0ba15a60fe [id=8babc41fda134da8987a2060959eed16]). Expected version 1 got 0
W20260812 19:26:45.819471 7962 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fb970cb3852940129aaefdc2208cf74d consensus state has no leader
I20260812 19:26:45.828421 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 33bcf8d54395461d9eb07965966153a1 (DEFAULT_TABLE table=default.Table_2d1f3cf019494f3ba9e1aa5492599638 [id=86f25ffe25e341069e55a288d5c0d998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.831333 8333 tablet_service.cc:1467] Processing CreateTablet for tablet b24558d110b044a58a0d31b9b9a16362 (DEFAULT_TABLE table=default.Table_f8ddd255d758494fb731ca72c5992730 [id=6335f2c2d0ec40baab46d0b760c3b3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.833202 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33bcf8d54395461d9eb07965966153a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.834417 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b24558d110b044a58a0d31b9b9a16362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.787173 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_cfb4d04872c64c22a0d2f4519acab91d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:45.837790 8412 tablet.cc:2369] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 19:26:45.838745 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cfb4d04872c64c22a0d2f4519acab91d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:45.791216 8088 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:26:45.843827 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 33bcf8d54395461d9eb07965966153a1 (DEFAULT_TABLE table=default.Table_2d1f3cf019494f3ba9e1aa5492599638 [id=86f25ffe25e341069e55a288d5c0d998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.845517 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33bcf8d54395461d9eb07965966153a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.844302 8088 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
I20260812 19:26:45.855362 8492 tablet_service.cc:1467] Processing CreateTablet for tablet b24558d110b044a58a0d31b9b9a16362 (DEFAULT_TABLE table=default.Table_f8ddd255d758494fb731ca72c5992730 [id=6335f2c2d0ec40baab46d0b760c3b3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.856930 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b24558d110b044a58a0d31b9b9a16362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.859609 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 33bcf8d54395461d9eb07965966153a1 (DEFAULT_TABLE table=default.Table_2d1f3cf019494f3ba9e1aa5492599638 [id=86f25ffe25e341069e55a288d5c0d998]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.861135 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33bcf8d54395461d9eb07965966153a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.866438 8158 tablet_service.cc:1467] Processing CreateTablet for tablet b24558d110b044a58a0d31b9b9a16362 (DEFAULT_TABLE table=default.Table_f8ddd255d758494fb731ca72c5992730 [id=6335f2c2d0ec40baab46d0b760c3b3b1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:45.868040 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b24558d110b044a58a0d31b9b9a16362. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:45.895892 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0c7c0145764cf8bd28de06f0465efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:45.897151 8624 tablet_replica.cc:330] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:45.898073 8624 raft_consensus.cc:2229] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:45.898684 8624 raft_consensus.cc:2258] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:45.901506 8635 raft_consensus.cc:482] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:45.901674 8624 ts_tablet_manager.cc:1905] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:45.902279 8635 raft_consensus.cc:504] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:45.907430 8623 tablet_bootstrap.cc:654] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:45.915093 8635 leader_election.cc:288] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:45.936195 8627 tablet_bootstrap.cc:492] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:45.936846 8627 ts_tablet_manager.cc:1397] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.216s user 0.073s sys 0.096s
I20260812 19:26:45.938292 8636 tablet_bootstrap.cc:492] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:45.939512 8627 raft_consensus.cc:348] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:45.944545 8627 raft_consensus.cc:374] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:45.944944 8627 raft_consensus.cc:729] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:45.945703 8627 consensus_queue.cc:260] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:45.947212 7956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet b24558d110b044a58a0d31b9b9a16362
I20260812 19:26:45.950675 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet b24558d110b044a58a0d31b9b9a16362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:45.955760 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet b24558d110b044a58a0d31b9b9a16362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:45.957227 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet b24558d110b044a58a0d31b9b9a16362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:45.958851 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet b24558d110b044a58a0d31b9b9a16362 because the tablet was not found. No further retry: Not found: Tablet not found: b24558d110b044a58a0d31b9b9a16362
W20260812 19:26:45.959947 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet b24558d110b044a58a0d31b9b9a16362 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b24558d110b044a58a0d31b9b9a16362 already in progress: creating tablet
I20260812 19:26:45.960426 8627 ts_tablet_manager.cc:1428] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.023s user 0.005s sys 0.002s
I20260812 19:26:45.944118 8624 ts_tablet_manager.cc:1918] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:45.961268 8624 log.cc:1196] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/cf0c7c0145764cf8bd28de06f0465efa
I20260812 19:26:45.961874 8623 log.cc:824] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Log is configured to *not* fsync() on all Append() calls
I20260812 19:26:45.964196 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:45.973455 8624 ts_tablet_manager.cc:1939] T cf0c7c0145764cf8bd28de06f0465efa P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:45.974236 8627 tablet_bootstrap.cc:492] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:45.979418 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 33bcf8d54395461d9eb07965966153a1
I20260812 19:26:45.939507 8636 ts_tablet_manager.cc:1397] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.228s user 0.042s sys 0.063s
I20260812 19:26:45.981017 8627 tablet_bootstrap.cc:654] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:45.987161 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bcf8d54395461d9eb07965966153a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:45.988698 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 33bcf8d54395461d9eb07965966153a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33bcf8d54395461d9eb07965966153a1 already in progress: creating tablet
I20260812 19:26:45.988884 8624 tablet_replica.cc:330] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:45.989603 8624 raft_consensus.cc:2229] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:45.990036 8624 raft_consensus.cc:2258] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:45.991936 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet cf0c7c0145764cf8bd28de06f0465efa (table default.Table_b5b633ce61c54d7fab68c049997c9490 [id=065b125b4f0844198044142564365015]) successfully deleted
W20260812 19:26:45.992722 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet b24558d110b044a58a0d31b9b9a16362 because the tablet was not found. No further retry: Not found: Tablet not found: b24558d110b044a58a0d31b9b9a16362
I20260812 19:26:45.991375 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bcf8d54395461d9eb07965966153a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:45.995429 8624 ts_tablet_manager.cc:1905] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:45.984678 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb970cb3852940129aaefdc2208cf74d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:46.001857 8281 leader_election.cc:341] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:46.003036 8623 tablet_bootstrap.cc:492] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:46.003578 8623 ts_tablet_manager.cc:1397] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.339s user 0.020s sys 0.000s
I20260812 19:26:46.004762 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bcf8d54395461d9eb07965966153a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:46.006479 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 33bcf8d54395461d9eb07965966153a1 because the tablet was not found. No further retry: Not found: Tablet not found: 33bcf8d54395461d9eb07965966153a1
I20260812 19:26:46.016054 8627 tablet_bootstrap.cc:492] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:46.016562 8627 ts_tablet_manager.cc:1397] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.043s user 0.010s sys 0.007s
I20260812 19:26:46.019093 8627 raft_consensus.cc:348] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.019804 8627 raft_consensus.cc:374] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.020056 8627 raft_consensus.cc:729] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.020690 8627 consensus_queue.cc:260] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.036767 8627 ts_tablet_manager.cc:1428] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.020s user 0.004s sys 0.002s
I20260812 19:26:46.042219 8627 tablet_bootstrap.cc:492] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:46.045502 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_73aa9e100b6f4d8c9a6c1a473d710e6d" } new_table_name: "default.Table_8e5fb52026fd44b5b0d7b8ac0469ce20" modify_external_catalogs: true
I20260812 19:26:46.049579 8627 tablet_bootstrap.cc:654] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.069344 8623 raft_consensus.cc:348] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.071681 8623 raft_consensus.cc:374] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.072464 8623 raft_consensus.cc:729] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.074041 7955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_6b4776007c0e48899ab8511dd1c578f1" } new_table_name: "default.Table_2083a9f074f24a1dbd1932caf189ad9b" modify_external_catalogs: true
I20260812 19:26:46.074424 8623 consensus_queue.cc:260] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.081434 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_1eecbc2fade2419c8dbe5aa9cc476103"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.083328 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1eecbc2fade2419c8dbe5aa9cc476103 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.093739 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]). Expected version 2 got 0
I20260812 19:26:46.094663 8627 tablet_bootstrap.cc:492] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:46.095201 8627 ts_tablet_manager.cc:1397] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.010s
I20260812 19:26:46.099045 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (DEFAULT_TABLE table=default.Table_73aa9e100b6f4d8c9a6c1a473d710e6d [id=3e92ad5d601b482aaabc37ffd7e7a9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.100178 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.082784 8624 ts_tablet_manager.cc:1918] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.100713 8624 log.cc:1196] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/a3cdba0279f747f68ad2cd5e4454da92
I20260812 19:26:46.100953 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (DEFAULT_TABLE table=default.Table_73aa9e100b6f4d8c9a6c1a473d710e6d [id=3e92ad5d601b482aaabc37ffd7e7a9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.101437 8624 ts_tablet_manager.cc:1939] T a3cdba0279f747f68ad2cd5e4454da92 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:46.102077 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.106446 8155 tablet_service.cc:1467] Processing CreateTablet for tablet ef215230eb7e456b8c3ec35f13c06920 (DEFAULT_TABLE table=default.Table_6b4776007c0e48899ab8511dd1c578f1 [id=a4a65136c70d4d33a3300ba7903c3ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.107599 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef215230eb7e456b8c3ec35f13c06920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.041127 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb970cb3852940129aaefdc2208cf74d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:46.112713 8278 leader_election.cc:341] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:46.113183 8278 leader_election.cc:302] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:46.115108 8635 raft_consensus.cc:2726] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:46.116957 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (DEFAULT_TABLE table=default.Table_73aa9e100b6f4d8c9a6c1a473d710e6d [id=3e92ad5d601b482aaabc37ffd7e7a9e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.122305 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet a3cdba0279f747f68ad2cd5e4454da92 (table default.Table_d2b76284c93f4e70ba5dd9ae73dce961 [id=07fc51bc81d848acbe4dff6fb6605ca6]) successfully deleted
I20260812 19:26:46.123045 8492 tablet_service.cc:1467] Processing CreateTablet for tablet ef215230eb7e456b8c3ec35f13c06920 (DEFAULT_TABLE table=default.Table_6b4776007c0e48899ab8511dd1c578f1 [id=a4a65136c70d4d33a3300ba7903c3ec2]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:46.123449 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 33bcf8d54395461d9eb07965966153a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 33bcf8d54395461d9eb07965966153a1 already in progress: creating tablet
I20260812 19:26:46.124179 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef215230eb7e456b8c3ec35f13c06920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.124308 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.132930 8329 tablet_service.cc:1467] Processing CreateTablet for tablet ef215230eb7e456b8c3ec35f13c06920 (DEFAULT_TABLE table=default.Table_6b4776007c0e48899ab8511dd1c578f1 [id=a4a65136c70d4d33a3300ba7903c3ec2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.134160 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef215230eb7e456b8c3ec35f13c06920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.135226 8627 raft_consensus.cc:348] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.135988 8627 raft_consensus.cc:374] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.138428 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]). Expected version 2 got 0
W20260812 19:26:46.144086 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a43b5f9446b4ed4a0349af7d8c16f8f consensus state has no leader
I20260812 19:26:46.139773 7956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_dd9b76e224ee42b18031c137d4ee7562"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.147537 7956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_dd9b76e224ee42b18031c137d4ee7562 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.151820 8627 raft_consensus.cc:729] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.156584 8623 ts_tablet_manager.cc:1428] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.153s user 0.028s sys 0.004s
I20260812 19:26:46.156879 7954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_352f3e372ef2499faa65351a421cb72b" } modify_external_catalogs: true
I20260812 19:26:46.160583 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet fb970cb3852940129aaefdc2208cf74d (table default.Table_352f3e372ef2499faa65351a421cb72b [id=8babc41fda134da8987a2060959eed16]). Expected version 2 got 0
I20260812 19:26:46.157809 8627 consensus_queue.cc:260] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.168582 7954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_352f3e372ef2499faa65351a421cb72b" } modify_external_catalogs: true
I20260812 19:26:46.163645 8636 raft_consensus.cc:348] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.176463 8636 raft_consensus.cc:374] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.181761 8627 ts_tablet_manager.cc:1428] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.086s user 0.006s sys 0.000s
I20260812 19:26:46.183058 8623 tablet_bootstrap.cc:492] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:46.185143 8636 raft_consensus.cc:729] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.186764 8636 consensus_queue.cc:260] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.191340 7960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cfb4d04872c64c22a0d2f4519acab91d" } modify_external_catalogs: true
I20260812 19:26:46.191933 7960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cfb4d04872c64c22a0d2f4519acab91d" } modify_external_catalogs: true
I20260812 19:26:46.198184 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet b24558d110b044a58a0d31b9b9a16362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:46.198948 8624 tablet_replica.cc:330] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:46.199684 8624 raft_consensus.cc:2229] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.200120 8624 raft_consensus.cc:2258] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.201612 8623 tablet_bootstrap.cc:654] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.202458 8624 ts_tablet_manager.cc:1905] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.216665 8636 ts_tablet_manager.cc:1428] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.236s user 0.043s sys 0.002s
I20260812 19:26:46.220736 8627 tablet_bootstrap.cc:492] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:46.229077 8627 tablet_bootstrap.cc:654] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.231536 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_527f80ad186f4cfc97e747e4b3d0ab03"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.233345 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_527f80ad186f4cfc97e747e4b3d0ab03 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:46.247709 7955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ef215230eb7e456b8c3ec35f13c06920 consensus state has no leader
W20260812 19:26:46.255894 8250 tablet.cc:2369] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:26:46.263931 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_bd975858d3874a0fb3e63c85fd13be32"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.265715 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bd975858d3874a0fb3e63c85fd13be32 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.269259 8636 tablet_bootstrap.cc:492] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:46.283761 8627 tablet_bootstrap.cc:492] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:46.284593 8627 ts_tablet_manager.cc:1397] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.064s user 0.014s sys 0.002s
I20260812 19:26:46.288430 8627 raft_consensus.cc:348] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.294283 8623 tablet_bootstrap.cc:492] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:46.294750 8623 ts_tablet_manager.cc:1397] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.112s user 0.002s sys 0.008s
I20260812 19:26:46.279861 8624 ts_tablet_manager.cc:1918] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.295344 8624 log.cc:1196] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/b24558d110b044a58a0d31b9b9a16362
I20260812 19:26:46.296541 8624 ts_tablet_manager.cc:1939] T b24558d110b044a58a0d31b9b9a16362 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:46.297425 8623 raft_consensus.cc:348] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.298198 8623 raft_consensus.cc:374] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.298486 8623 raft_consensus.cc:729] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.294785 8627 raft_consensus.cc:374] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.298972 8627 raft_consensus.cc:729] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.300592 8636 tablet_bootstrap.cc:654] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.308772 8627 consensus_queue.cc:260] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.310950 8623 consensus_queue.cc:260] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.315097 8623 ts_tablet_manager.cc:1428] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.020s user 0.009s sys 0.000s
I20260812 19:26:46.316290 8623 tablet_bootstrap.cc:492] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:26:46.326700 8575 tablet.cc:2369] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:26:46.328964 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet b24558d110b044a58a0d31b9b9a16362 (table default.Table_f8ddd255d758494fb731ca72c5992730 [id=6335f2c2d0ec40baab46d0b760c3b3b1]) successfully deleted
I20260812 19:26:46.330612 8627 ts_tablet_manager.cc:1428] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.046s user 0.007s sys 0.001s
I20260812 19:26:46.331687 8627 tablet_bootstrap.cc:492] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:46.322216 8623 tablet_bootstrap.cc:654] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.342573 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet fb970cb3852940129aaefdc2208cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:46.342963 7954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet fb970cb3852940129aaefdc2208cf74d
I20260812 19:26:46.343582 8625 tablet_replica.cc:330] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:46.344458 8625 raft_consensus.cc:2229] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.345036 8625 raft_consensus.cc:2258] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.346855 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet fb970cb3852940129aaefdc2208cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:46.347188 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet fb970cb3852940129aaefdc2208cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:46.348078 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet fb970cb3852940129aaefdc2208cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:46.348824 8624 tablet_replica.cc:330] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:26:46.349252 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet fb970cb3852940129aaefdc2208cf74d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet fb970cb3852940129aaefdc2208cf74d already in progress: creating tablet
I20260812 19:26:46.349633 8624 raft_consensus.cc:2229] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.349716 8625 ts_tablet_manager.cc:1905] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.350086 8624 raft_consensus.cc:2258] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.351378 7954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_dd9b76e224ee42b18031c137d4ee7562" } new_table_name: "default.Table_720375e2fa9e4667955d0ee24a1e09e9" modify_external_catalogs: true
I20260812 19:26:46.351855 8624 ts_tablet_manager.cc:1905] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.360626 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0c7c0145764cf8bd28de06f0465efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:46.358976 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bcf8d54395461d9eb07965966153a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:46.370575 8627 tablet_bootstrap.cc:654] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.388908 8625 ts_tablet_manager.cc:1918] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260812 19:26:46.394228 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ef215230eb7e456b8c3ec35f13c06920 (table default.Table_2083a9f074f24a1dbd1932caf189ad9b [id=a4a65136c70d4d33a3300ba7903c3ec2], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ef215230eb7e456b8c3ec35f13c06920 consensus state has no leader
I20260812 19:26:46.395460 8636 tablet_bootstrap.cc:492] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:46.396311 8636 ts_tablet_manager.cc:1397] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.127s user 0.015s sys 0.011s
I20260812 19:26:46.396806 8625 log.cc:1196] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/fb970cb3852940129aaefdc2208cf74d
I20260812 19:26:46.398765 8627 tablet_bootstrap.cc:492] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:46.405189 8625 ts_tablet_manager.cc:1939] T fb970cb3852940129aaefdc2208cf74d P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:46.408717 8627 ts_tablet_manager.cc:1397] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.077s user 0.002s sys 0.013s
I20260812 19:26:46.409981 8625 tablet_replica.cc:330] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
W20260812 19:26:46.414460 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet fb970cb3852940129aaefdc2208cf74d because the tablet was not found. No further retry: Not found: Tablet not found: fb970cb3852940129aaefdc2208cf74d
I20260812 19:26:46.414710 8625 raft_consensus.cc:2229] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.416239 8625 raft_consensus.cc:2258] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.403379 8636 raft_consensus.cc:348] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.422847 8623 tablet_bootstrap.cc:492] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:46.422962 8636 raft_consensus.cc:374] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.423863 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_089b7ab1b51d425788a8678f7d714ed6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:46.424659 8623 ts_tablet_manager.cc:1397] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.109s user 0.012s sys 0.016s
I20260812 19:26:46.424181 8627 raft_consensus.cc:348] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.425163 8627 raft_consensus.cc:374] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.425590 8627 raft_consensus.cc:729] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:26:46.425705 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_089b7ab1b51d425788a8678f7d714ed6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.426417 8636 raft_consensus.cc:729] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.427240 8623 raft_consensus.cc:348] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.427963 8623 raft_consensus.cc:374] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.428223 8623 raft_consensus.cc:729] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.427618 8636 consensus_queue.cc:260] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.428643 8625 ts_tablet_manager.cc:1905] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.431757 8627 consensus_queue.cc:260] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.444024 8635 raft_consensus.cc:482] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:46.444326 7958 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]). Expected version 2 got 0
I20260812 19:26:46.444483 8635 raft_consensus.cc:504] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.444561 8623 consensus_queue.cc:260] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.446476 8635 leader_election.cc:288] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:46.448585 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef215230eb7e456b8c3ec35f13c06920" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:46.449510 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 719b756d5db14d61948280d42a42234a (DEFAULT_TABLE table=default.Table_cfb4d04872c64c22a0d2f4519acab91d [id=93e1bfb55e0448178d16c0c7b724eeaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.449810 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef215230eb7e456b8c3ec35f13c06920" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:46.451508 8330 tablet_service.cc:1467] Processing CreateTablet for tablet e1198960d8ea400387d189762d9549b6 (DEFAULT_TABLE table=default.Table_950444052d854c34a6f03fe473988bff [id=786445bdb3f24639b52a307912df394d]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:46.452963 8281 leader_election.cc:341] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:46.454046 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 719b756d5db14d61948280d42a42234a (DEFAULT_TABLE table=default.Table_cfb4d04872c64c22a0d2f4519acab91d [id=93e1bfb55e0448178d16c0c7b724eeaa]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:46.454157 8278 leader_election.cc:341] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:46.454669 8278 leader_election.cc:302] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:46.455191 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 719b756d5db14d61948280d42a42234a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.455331 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 719b756d5db14d61948280d42a42234a (DEFAULT_TABLE table=default.Table_cfb4d04872c64c22a0d2f4519acab91d [id=93e1bfb55e0448178d16c0c7b724eeaa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.456571 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 719b756d5db14d61948280d42a42234a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.456985 8492 tablet_service.cc:1467] Processing CreateTablet for tablet e1198960d8ea400387d189762d9549b6 (DEFAULT_TABLE table=default.Table_950444052d854c34a6f03fe473988bff [id=786445bdb3f24639b52a307912df394d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.456995 8155 tablet_service.cc:1467] Processing CreateTablet for tablet e1198960d8ea400387d189762d9549b6 (DEFAULT_TABLE table=default.Table_950444052d854c34a6f03fe473988bff [id=786445bdb3f24639b52a307912df394d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.457968 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1198960d8ea400387d189762d9549b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.460700 8623 ts_tablet_manager.cc:1428] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20260812 19:26:46.463419 8623 tablet_bootstrap.cc:492] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:46.470095 8635 raft_consensus.cc:2726] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:46.472069 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1198960d8ea400387d189762d9549b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.475679 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_1eecbc2fade2419c8dbe5aa9cc476103" } new_table_name: "default.Table_4219b6e538dd4ae38c115865affc34be" modify_external_catalogs: true
I20260812 19:26:46.480115 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet ef215230eb7e456b8c3ec35f13c06920 (table default.Table_2083a9f074f24a1dbd1932caf189ad9b [id=a4a65136c70d4d33a3300ba7903c3ec2]). Expected version 1 got 0
I20260812 19:26:46.484404 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:46.489517 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0c7c0145764cf8bd28de06f0465efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:46.492059 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet cf0c7c0145764cf8bd28de06f0465efa because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cf0c7c0145764cf8bd28de06f0465efa already in progress: creating tablet
I20260812 19:26:46.497787 8627 ts_tablet_manager.cc:1428] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.087s user 0.006s sys 0.001s
I20260812 19:26:46.498215 7956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_f3c62d8240bd45808b7bc0280e391198"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.499985 7956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f3c62d8240bd45808b7bc0280e391198 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.443341 8636 ts_tablet_manager.cc:1428] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.044s user 0.009s sys 0.001s
I20260812 19:26:46.504914 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 719b756d5db14d61948280d42a42234a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.513025 8627 tablet_bootstrap.cc:492] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:26:46.514981 7954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet d3be82128696447e85758e8595b7e9e6 has no consensus state
I20260812 19:26:46.519371 8627 tablet_bootstrap.cc:654] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.520593 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e1198960d8ea400387d189762d9549b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.521162 7959 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet ef215230eb7e456b8c3ec35f13c06920 (table default.Table_2083a9f074f24a1dbd1932caf189ad9b [id=a4a65136c70d4d33a3300ba7903c3ec2]). Expected version 1 got 0
I20260812 19:26:46.528858 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet cf0c7c0145764cf8bd28de06f0465efa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:46.529794 8626 tablet_replica.cc:330] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:46.530668 8626 raft_consensus.cc:2229] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.531216 8626 raft_consensus.cc:2258] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:46.531901 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 77655.6us
I20260812 19:26:46.535228 8626 ts_tablet_manager.cc:1905] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.545854 8636 tablet_bootstrap.cc:492] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:46.551777 8636 tablet_bootstrap.cc:654] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.565816 8625 ts_tablet_manager.cc:1918] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.565841 8659 raft_consensus.cc:482] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:46.566311 8659 raft_consensus.cc:504] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.568061 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2083a9f074f24a1dbd1932caf189ad9b" } modify_external_catalogs: true
I20260812 19:26:46.569172 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2083a9f074f24a1dbd1932caf189ad9b" } modify_external_catalogs: true
I20260812 19:26:46.568243 8659 leader_election.cc:288] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:46.573148 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac608059319748a1b34510267c813f47" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:46.586500 8517 raft_consensus.cc:2454] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:26:46.586710 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_49512314d04b46c2b5c304968d0426a4"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:46.587990 8278 leader_election.cc:302] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:26:46.588613 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_49512314d04b46c2b5c304968d0426a4 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.588924 8659 raft_consensus.cc:2781] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:46.589246 8659 raft_consensus.cc:482] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:46.589550 8659 raft_consensus.cc:3037] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:46.505177 8624 ts_tablet_manager.cc:1918] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.592478 8624 log.cc:1196] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/fb970cb3852940129aaefdc2208cf74d
I20260812 19:26:46.593181 8624 ts_tablet_manager.cc:1939] T fb970cb3852940129aaefdc2208cf74d P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:46.595564 8624 tablet_replica.cc:330] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:46.595779 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet fb970cb3852940129aaefdc2208cf74d (table default.Table_352f3e372ef2499faa65351a421cb72b [id=8babc41fda134da8987a2060959eed16]) successfully deleted
I20260812 19:26:46.596786 8659 raft_consensus.cc:504] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.601691 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac608059319748a1b34510267c813f47" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:46.602239 8517 raft_consensus.cc:3037] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:46.603434 8659 leader_election.cc:288] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:46.606644 7960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 719b756d5db14d61948280d42a42234a
I20260812 19:26:46.609659 8624 raft_consensus.cc:2229] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.610251 8624 raft_consensus.cc:2258] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.611349 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet 719b756d5db14d61948280d42a42234a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:46.612112 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 719b756d5db14d61948280d42a42234a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:46.612339 8517 raft_consensus.cc:2454] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:26:46.613906 8278 leader_election.cc:302] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:46.615196 8659 raft_consensus.cc:2781] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:46.615806 8659 raft_consensus.cc:686] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:26:46.616726 8659 consensus_queue.cc:237] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.617826 8636 tablet_bootstrap.cc:492] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:46.618287 8636 ts_tablet_manager.cc:1397] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.073s user 0.010s sys 0.002s
I20260812 19:26:46.617951 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_23fba63fdbc84d25b260bc3ba2434a92"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.619728 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_23fba63fdbc84d25b260bc3ba2434a92 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.621569 8624 ts_tablet_manager.cc:1905] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.624083 8636 raft_consensus.cc:348] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.569975 8623 tablet_bootstrap.cc:654] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.632426 8625 log.cc:1196] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/cf0c7c0145764cf8bd28de06f0465efa
I20260812 19:26:46.569674 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac608059319748a1b34510267c813f47" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:46.635898 8625 ts_tablet_manager.cc:1939] T cf0c7c0145764cf8bd28de06f0465efa P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:46.599717 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac608059319748a1b34510267c813f47" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:46.639401 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet cf0c7c0145764cf8bd28de06f0465efa (table default.Table_b5b633ce61c54d7fab68c049997c9490 [id=065b125b4f0844198044142564365015]) successfully deleted
W20260812 19:26:46.640537 8281 leader_election.cc:341] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:46.641325 8636 raft_consensus.cc:374] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:26:46.641705 8281 leader_election.cc:341] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:46.613480 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 719b756d5db14d61948280d42a42234a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:46.642093 8636 raft_consensus.cc:729] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.648486 8636 consensus_queue.cc:260] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:46.651475 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet baf3e61bb2ab45d19d3ed0169f0a6cdb has no consensus state
I20260812 19:26:46.627606 8626 ts_tablet_manager.cc:1918] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.652307 8626 log.cc:1196] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/cf0c7c0145764cf8bd28de06f0465efa
I20260812 19:26:46.653333 8623 tablet_bootstrap.cc:492] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:46.653925 8623 ts_tablet_manager.cc:1397] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.191s user 0.014s sys 0.004s
I20260812 19:26:46.658227 8625 tablet_replica.cc:330] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:46.659629 8623 raft_consensus.cc:348] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.660449 8623 raft_consensus.cc:374] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.660720 8623 raft_consensus.cc:729] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.661312 8625 raft_consensus.cc:2229] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.661796 8625 raft_consensus.cc:2258] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.661386 8623 consensus_queue.cc:260] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.662778 8627 tablet_bootstrap.cc:492] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:46.663177 8627 ts_tablet_manager.cc:1397] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.150s user 0.055s sys 0.058s
I20260812 19:26:46.666137 8623 ts_tablet_manager.cc:1428] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260812 19:26:46.669534 8623 tablet_bootstrap.cc:492] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:46.676877 8623 tablet_bootstrap.cc:654] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.682785 8625 ts_tablet_manager.cc:1905] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.682905 8627 raft_consensus.cc:348] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.683895 8627 raft_consensus.cc:374] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.684237 8627 raft_consensus.cc:729] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.678736 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet a3cdba0279f747f68ad2cd5e4454da92 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:46.685228 8627 consensus_queue.cc:260] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.686939 8626 ts_tablet_manager.cc:1939] T cf0c7c0145764cf8bd28de06f0465efa P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:46.690151 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet cf0c7c0145764cf8bd28de06f0465efa (table default.Table_b5b633ce61c54d7fab68c049997c9490 [id=065b125b4f0844198044142564365015]) successfully deleted
I20260812 19:26:46.690811 8636 ts_tablet_manager.cc:1428] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.072s user 0.006s sys 0.000s
I20260812 19:26:46.691829 8636 tablet_bootstrap.cc:492] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:46.695346 8627 ts_tablet_manager.cc:1428] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.032s user 0.003s sys 0.004s
W20260812 19:26:46.706772 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 719b756d5db14d61948280d42a42234a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 719b756d5db14d61948280d42a42234a already in progress: creating tablet
I20260812 19:26:46.711828 8627 tablet_bootstrap.cc:492] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:46.718654 8627 tablet_bootstrap.cc:654] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.722704 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8e5fb52026fd44b5b0d7b8ac0469ce20" } new_table_name: "default.Table_3333c00eaad84adca3cfc46ecdae1d7b" modify_external_catalogs: true
I20260812 19:26:46.735204 8627 tablet_bootstrap.cc:492] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:46.735882 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet ef215230eb7e456b8c3ec35f13c06920
I20260812 19:26:46.735845 8627 ts_tablet_manager.cc:1397] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.000s
I20260812 19:26:46.739569 8627 raft_consensus.cc:348] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.740695 8627 raft_consensus.cc:374] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.741070 8627 raft_consensus.cc:729] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.742280 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet ef215230eb7e456b8c3ec35f13c06920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:46.741916 8627 consensus_queue.cc:260] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.743476 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet ef215230eb7e456b8c3ec35f13c06920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:46.745048 8627 ts_tablet_manager.cc:1428] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20260812 19:26:46.747772 8627 tablet_bootstrap.cc:492] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:46.749675 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet ef215230eb7e456b8c3ec35f13c06920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:46.752981 8627 tablet_bootstrap.cc:654] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.773712 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8f4b0588af9946aa8241760c94c19731"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.775522 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8f4b0588af9946aa8241760c94c19731 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:46.785001 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 2a43b5f9446b4ed4a0349af7d8c16f8f consensus state has no leader
I20260812 19:26:46.788496 8623 tablet_bootstrap.cc:492] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:46.789348 8623 ts_tablet_manager.cc:1397] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.120s user 0.022s sys 0.055s
I20260812 19:26:46.769896 8626 tablet_replica.cc:330] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:46.793255 8626 raft_consensus.cc:2229] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.793784 8626 raft_consensus.cc:2258] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.793738 8623 raft_consensus.cc:348] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.795086 8623 raft_consensus.cc:374] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.795607 8623 raft_consensus.cc:729] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.797257 8636 tablet_bootstrap.cc:654] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.796867 8623 consensus_queue.cc:260] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.803510 8627 tablet_bootstrap.cc:492] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:46.803968 8627 ts_tablet_manager.cc:1397] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.058s user 0.016s sys 0.004s
I20260812 19:26:46.804023 8623 ts_tablet_manager.cc:1428] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.014s user 0.009s sys 0.000s
I20260812 19:26:46.805898 8626 ts_tablet_manager.cc:1905] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.806524 8627 raft_consensus.cc:348] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.807353 8627 raft_consensus.cc:374] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.807678 8627 raft_consensus.cc:729] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.808475 8627 consensus_queue.cc:260] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.810322 8623 tablet_bootstrap.cc:492] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:46.816704 8627 ts_tablet_manager.cc:1428] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.012s user 0.008s sys 0.000s
I20260812 19:26:46.821494 8623 tablet_bootstrap.cc:654] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.827543 8624 ts_tablet_manager.cc:1918] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.828020 8624 log.cc:1196] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/33bcf8d54395461d9eb07965966153a1
I20260812 19:26:46.833525 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_720375e2fa9e4667955d0ee24a1e09e9" } modify_external_catalogs: true
I20260812 19:26:46.834296 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_720375e2fa9e4667955d0ee24a1e09e9" } modify_external_catalogs: true
I20260812 19:26:46.837060 8624 ts_tablet_manager.cc:1939] T 33bcf8d54395461d9eb07965966153a1 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:46.842964 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 33bcf8d54395461d9eb07965966153a1 (table default.Table_2d1f3cf019494f3ba9e1aa5492599638 [id=86f25ffe25e341069e55a288d5c0d998]) successfully deleted
I20260812 19:26:46.843664 8625 ts_tablet_manager.cc:1918] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.844511 8624 tablet_replica.cc:330] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:46.845515 8625 log.cc:1196] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/a3cdba0279f747f68ad2cd5e4454da92
I20260812 19:26:46.846268 8625 ts_tablet_manager.cc:1939] T a3cdba0279f747f68ad2cd5e4454da92 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:46.844718 8623 tablet_bootstrap.cc:492] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:46.850559 8623 ts_tablet_manager.cc:1397] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.040s user 0.019s sys 0.009s
I20260812 19:26:46.854803 8624 raft_consensus.cc:2229] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.854992 7953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_527f80ad186f4cfc97e747e4b3d0ab03" } new_table_name: "default.Table_3750cdaa1c8a4721bec69106a1744794" modify_external_catalogs: true
I20260812 19:26:46.857017 8624 raft_consensus.cc:2258] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.861541 8623 raft_consensus.cc:348] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.862326 8623 raft_consensus.cc:374] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.862627 8624 ts_tablet_manager.cc:1905] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.862622 8623 raft_consensus.cc:729] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.865337 8623 consensus_queue.cc:260] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.866190 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet a3cdba0279f747f68ad2cd5e4454da92 (table default.Table_d2b76284c93f4e70ba5dd9ae73dce961 [id=07fc51bc81d848acbe4dff6fb6605ca6]) successfully deleted
W20260812 19:26:46.867003 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 719b756d5db14d61948280d42a42234a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 719b756d5db14d61948280d42a42234a already in progress: creating tablet
I20260812 19:26:46.867637 8623 ts_tablet_manager.cc:1428] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.017s user 0.000s sys 0.004s
W20260812 19:26:46.867658 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet ef215230eb7e456b8c3ec35f13c06920 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef215230eb7e456b8c3ec35f13c06920 already in progress: creating tablet
I20260812 19:26:46.868559 8623 tablet_bootstrap.cc:492] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:46.874951 8623 tablet_bootstrap.cc:654] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.874977 7959 catalog_manager.cc:5495] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:46.877919 7959 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]). Expected version 2 got 0
I20260812 19:26:46.885675 8626 ts_tablet_manager.cc:1918] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.889580 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 650cd08798724b6cb5f7026cd0631b65 (DEFAULT_TABLE table=default.Table_bd975858d3874a0fb3e63c85fd13be32 [id=207aa714585c4a20a2ccb8fc894c04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.890764 8626 log.cc:1196] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/a3cdba0279f747f68ad2cd5e4454da92
I20260812 19:26:46.891399 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 650cd08798724b6cb5f7026cd0631b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.895323 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_e010f3079ed44b45a4fc2e16e494a9aa"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.897784 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e010f3079ed44b45a4fc2e16e494a9aa in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.903466 8626 ts_tablet_manager.cc:1939] T a3cdba0279f747f68ad2cd5e4454da92 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:46.911754 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet a3cdba0279f747f68ad2cd5e4454da92 (table default.Table_d2b76284c93f4e70ba5dd9ae73dce961 [id=07fc51bc81d848acbe4dff6fb6605ca6]) successfully deleted
W20260812 19:26:46.914412 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet ef215230eb7e456b8c3ec35f13c06920 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet ef215230eb7e456b8c3ec35f13c06920 already in progress: creating tablet
I20260812 19:26:46.918231 8623 tablet_bootstrap.cc:492] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:46.918800 8623 ts_tablet_manager.cc:1397] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.050s user 0.017s sys 0.031s
W20260812 19:26:46.919302 7953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 336e05589e784e768695439e7dc93b71 consensus state has no leader
I20260812 19:26:46.922165 8623 raft_consensus.cc:348] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.923044 8623 raft_consensus.cc:374] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:46.923382 8624 ts_tablet_manager.cc:1918] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.923454 8623 raft_consensus.cc:729] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:46.923933 8624 log.cc:1196] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/719b756d5db14d61948280d42a42234a
I20260812 19:26:46.924707 8624 ts_tablet_manager.cc:1939] T 719b756d5db14d61948280d42a42234a P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:46.924281 8623 consensus_queue.cc:260] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:46.926548 8623 ts_tablet_manager.cc:1428] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260812 19:26:46.927497 8648 raft_consensus.cc:482] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:46.927496 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 719b756d5db14d61948280d42a42234a (table default.Table_cfb4d04872c64c22a0d2f4519acab91d [id=93e1bfb55e0448178d16c0c7b724eeaa]) successfully deleted
I20260812 19:26:46.928022 8648 raft_consensus.cc:504] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:46.929723 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 650cd08798724b6cb5f7026cd0631b65 (DEFAULT_TABLE table=default.Table_bd975858d3874a0fb3e63c85fd13be32 [id=207aa714585c4a20a2ccb8fc894c04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.929976 8492 tablet_service.cc:1467] Processing CreateTablet for tablet 650cd08798724b6cb5f7026cd0631b65 (DEFAULT_TABLE table=default.Table_bd975858d3874a0fb3e63c85fd13be32 [id=207aa714585c4a20a2ccb8fc894c04b4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.930855 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 650cd08798724b6cb5f7026cd0631b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.931090 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 650cd08798724b6cb5f7026cd0631b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.937404 8648 leader_election.cc:288] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:46.938277 8624 tablet_replica.cc:330] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:46.939090 8624 raft_consensus.cc:2229] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:46.939572 8624 raft_consensus.cc:2258] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:46.941385 8624 ts_tablet_manager.cc:1905] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:46.944212 8158 tablet_service.cc:1467] Processing CreateTablet for tablet d3be82128696447e85758e8595b7e9e6 (DEFAULT_TABLE table=default.Table_720375e2fa9e4667955d0ee24a1e09e9 [id=a50462e739154544ba191948a1e77814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:46.945676 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3be82128696447e85758e8595b7e9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:46.945693 8627 tablet_bootstrap.cc:492] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:46.948819 8623 tablet_bootstrap.cc:492] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:46.950848 8627 tablet_bootstrap.cc:654] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.955909 8623 tablet_bootstrap.cc:654] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:46.957734 7953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e0736121494346cc84c7333ef09a8697" } modify_external_catalogs: true
I20260812 19:26:46.958495 7953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e0736121494346cc84c7333ef09a8697" } modify_external_catalogs: true
I20260812 19:26:46.964402 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_5f3b3da73f7c4eed96a5b76480cabbf0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:46.966215 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5f3b3da73f7c4eed96a5b76480cabbf0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:46.968686 8624 ts_tablet_manager.cc:1918] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:46.969179 8624 log.cc:1196] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/ef215230eb7e456b8c3ec35f13c06920
I20260812 19:26:46.969905 8624 ts_tablet_manager.cc:1939] T ef215230eb7e456b8c3ec35f13c06920 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:46.972486 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet ef215230eb7e456b8c3ec35f13c06920 (table default.Table_2083a9f074f24a1dbd1932caf189ad9b [id=a4a65136c70d4d33a3300ba7903c3ec2]) successfully deleted
I20260812 19:26:46.976738 7954 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]). Expected version 2 got 0
I20260812 19:26:47.001454 8627 tablet_bootstrap.cc:492] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:47.002355 8627 ts_tablet_manager.cc:1397] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.057s user 0.016s sys 0.020s
I20260812 19:26:47.005034 7962 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_f3c62d8240bd45808b7bc0280e391198" } new_table_name: "default.Table_93219d4aa801471ab3650eb30f289b21" modify_external_catalogs: true
I20260812 19:26:47.005916 8636 tablet_bootstrap.cc:492] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:47.007543 8623 tablet_bootstrap.cc:492] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.008034 8623 ts_tablet_manager.cc:1397] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.008s
I20260812 19:26:47.008478 8330 tablet_service.cc:1467] Processing CreateTablet for tablet d3be82128696447e85758e8595b7e9e6 (DEFAULT_TABLE table=default.Table_720375e2fa9e4667955d0ee24a1e09e9 [id=a50462e739154544ba191948a1e77814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.009646 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3be82128696447e85758e8595b7e9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.009588 7956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_efbd37ddd76e44dcb7b965fc04ea412b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:47.010380 8623 raft_consensus.cc:348] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.011056 8623 raft_consensus.cc:374] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.011294 8623 raft_consensus.cc:729] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
W20260812 19:26:47.011324 7956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_efbd37ddd76e44dcb7b965fc04ea412b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:47.011864 8623 consensus_queue.cc:260] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.013159 8627 raft_consensus.cc:348] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.014052 8627 raft_consensus.cc:374] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.014492 8627 raft_consensus.cc:729] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.015354 8627 consensus_queue.cc:260] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.020673 8636 ts_tablet_manager.cc:1397] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.329s user 0.011s sys 0.001s
I20260812 19:26:47.033433 8154 tablet_service.cc:1467] Processing CreateTablet for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb (DEFAULT_TABLE table=default.Table_4219b6e538dd4ae38c115865affc34be [id=09aaec16deb046efb62c0b8f6f3b0ea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.034677 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.023530 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b24558d110b044a58a0d31b9b9a16362" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:47.044209 8107 leader_election.cc:341] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.030484 8494 tablet_service.cc:1467] Processing CreateTablet for tablet d3be82128696447e85758e8595b7e9e6 (DEFAULT_TABLE table=default.Table_720375e2fa9e4667955d0ee24a1e09e9 [id=a50462e739154544ba191948a1e77814]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.045725 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3be82128696447e85758e8595b7e9e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.045293 8636 raft_consensus.cc:348] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.046026 8636 raft_consensus.cc:374] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.046296 8636 raft_consensus.cc:729] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.053944 8623 ts_tablet_manager.cc:1428] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.046s user 0.004s sys 0.000s
I20260812 19:26:47.059422 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8245870ce169462aae22b255c1803d28"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:47.061218 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8245870ce169462aae22b255c1803d28 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:47.069893 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet d3be82128696447e85758e8595b7e9e6
I20260812 19:26:47.074900 8517 raft_consensus.cc:1261] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Refusing update from remote peer 93aafc5b36824666a82aa55bc73df9e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:26:47.075001 8627 ts_tablet_manager.cc:1428] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.072s user 0.002s sys 0.004s
I20260812 19:26:47.077899 8659 consensus_queue.cc:1035] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:47.079540 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet d3be82128696447e85758e8595b7e9e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:47.080056 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet d3be82128696447e85758e8595b7e9e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44394
W20260812 19:26:47.081382 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet d3be82128696447e85758e8595b7e9e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3be82128696447e85758e8595b7e9e6 already in progress: creating tablet
W20260812 19:26:47.083125 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet d3be82128696447e85758e8595b7e9e6 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet d3be82128696447e85758e8595b7e9e6 already in progress: creating tablet
I20260812 19:26:47.063673 8180 raft_consensus.cc:3037] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.073196 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet d3be82128696447e85758e8595b7e9e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:47.088104 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet d3be82128696447e85758e8595b7e9e6 because the tablet was not found. No further retry: Not found: Tablet not found: d3be82128696447e85758e8595b7e9e6
W20260812 19:26:47.076395 8108 leader_election.cc:341] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: b24558d110b044a58a0d31b9b9a16362
I20260812 19:26:47.088932 8108 leader_election.cc:302] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:47.090389 8675 raft_consensus.cc:2726] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:47.091244 8675 raft_consensus.cc:482] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:47.091650 8675 raft_consensus.cc:504] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.093739 8675 leader_election.cc:288] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:47.094787 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a43b5f9446b4ed4a0349af7d8c16f8f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:47.096279 8107 leader_election.cc:341] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.097407 8333 tablet_service.cc:1467] Processing CreateTablet for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb (DEFAULT_TABLE table=default.Table_4219b6e538dd4ae38c115865affc34be [id=09aaec16deb046efb62c0b8f6f3b0ea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.097550 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a43b5f9446b4ed4a0349af7d8c16f8f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:47.098547 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.098474 8356 raft_consensus.cc:2454] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:47.099619 8108 leader_election.cc:302] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:47.100901 8675 raft_consensus.cc:2781] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:47.101295 8675 raft_consensus.cc:482] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:47.101660 8675 raft_consensus.cc:3037] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.105947 8623 tablet_bootstrap.cc:492] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:47.117848 8627 tablet_bootstrap.cc:492] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:47.120373 8494 tablet_service.cc:1467] Processing CreateTablet for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb (DEFAULT_TABLE table=default.Table_4219b6e538dd4ae38c115865affc34be [id=09aaec16deb046efb62c0b8f6f3b0ea6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.121490 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.122747 8180 raft_consensus.cc:1261] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Refusing update from remote peer 93aafc5b36824666a82aa55bc73df9e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:26:47.126715 8659 consensus_queue.cc:1035] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:47.131639 8627 tablet_bootstrap.cc:654] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.145192 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 336e05589e784e768695439e7dc93b71 (DEFAULT_TABLE table=default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.146409 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336e05589e784e768695439e7dc93b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.151472 8623 tablet_bootstrap.cc:654] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.161221 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3333c00eaad84adca3cfc46ecdae1d7b" } new_table_name: "default.Table_63698336eb614df88eca5031884199fd" modify_external_catalogs: true
I20260812 19:26:47.108834 8675 raft_consensus.cc:504] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.181707 8636 consensus_queue.cc:260] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.184034 8636 ts_tablet_manager.cc:1428] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.141s user 0.004s sys 0.000s
I20260812 19:26:47.184721 8675 leader_election.cc:288] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:47.187791 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 336e05589e784e768695439e7dc93b71 (DEFAULT_TABLE table=default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.188561 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a43b5f9446b4ed4a0349af7d8c16f8f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:47.189062 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336e05589e784e768695439e7dc93b71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.189153 8356 raft_consensus.cc:3037] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.195966 8356 raft_consensus.cc:2454] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:47.198942 8108 leader_election.cc:302] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:47.199827 8675 raft_consensus.cc:2781] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:47.200577 8675 raft_consensus.cc:686] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:47.201465 8675 consensus_queue.cc:237] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.210613 8623 tablet_bootstrap.cc:492] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.211216 8623 ts_tablet_manager.cc:1397] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.105s user 0.012s sys 0.002s
I20260812 19:26:47.214025 8623 raft_consensus.cc:348] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.215734 8623 raft_consensus.cc:374] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.215780 8627 tablet_bootstrap.cc:492] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:47.216440 8627 ts_tablet_manager.cc:1397] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.099s user 0.009s sys 0.003s
I20260812 19:26:47.216391 8623 raft_consensus.cc:729] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.217353 8623 consensus_queue.cc:260] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.220249 8627 raft_consensus.cc:348] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.220788 8623 ts_tablet_manager.cc:1428] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260812 19:26:47.223379 8623 tablet_bootstrap.cc:492] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:47.185475 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a43b5f9446b4ed4a0349af7d8c16f8f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:47.230751 8623 tablet_bootstrap.cc:654] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.231057 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 336e05589e784e768695439e7dc93b71 (DEFAULT_TABLE table=default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.238864 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 336e05589e784e768695439e7dc93b71. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:47.240579 8107 leader_election.cc:341] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.185088 8636 tablet_bootstrap.cc:492] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:47.248694 8627 raft_consensus.cc:374] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.252444 8627 raft_consensus.cc:729] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.253460 8627 consensus_queue.cc:260] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.249850 8693 tablet.cc:1722] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:47.271687 8623 tablet_bootstrap.cc:492] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.276779 8623 ts_tablet_manager.cc:1397] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.054s user 0.011s sys 0.001s
I20260812 19:26:47.277062 8683 mvcc.cc:205] Tried to move back new op lower bound from 7317761257654726656 to 7317761255928541184. Current Snapshot: MvccSnapshot[applied={T|T < 7317761257654726656}]
I20260812 19:26:47.280985 7952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8f4b0588af9946aa8241760c94c19731" } modify_external_catalogs: true
I20260812 19:26:47.281644 8659 raft_consensus.cc:482] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:47.281759 7952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8f4b0588af9946aa8241760c94c19731" } modify_external_catalogs: true
I20260812 19:26:47.282104 8659 raft_consensus.cc:504] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.287261 8627 ts_tablet_manager.cc:1428] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.070s user 0.008s sys 0.003s
I20260812 19:26:47.287279 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1198960d8ea400387d189762d9549b6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:47.288527 8697 tablet.cc:1722] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260812 19:26:47.289024 8278 leader_election.cc:341] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.295105 8659 leader_election.cc:288] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:47.279881 8623 raft_consensus.cc:348] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.297039 8623 raft_consensus.cc:374] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.297327 8623 raft_consensus.cc:729] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.299160 8623 consensus_queue.cc:260] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.300034 8684 mvcc.cc:205] Tried to move back new op lower bound from 7317761257654726656 to 7317761255928541184. Current Snapshot: MvccSnapshot[applied={T|T < 7317761257654726656}]
I20260812 19:26:47.306917 8627 tablet_bootstrap.cc:492] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:47.309372 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1198960d8ea400387d189762d9549b6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:47.310063 8182 raft_consensus.cc:2454] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:26:47.316886 8281 leader_election.cc:302] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:47.321691 8691 raft_consensus.cc:2781] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:47.322326 8691 raft_consensus.cc:482] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:47.322739 8691 raft_consensus.cc:3037] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.325910 8700 tablet.cc:1722] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:47.326568 7953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet ac608059319748a1b34510267c813f47
I20260812 19:26:47.328748 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet ac608059319748a1b34510267c813f47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:47.329514 8624 tablet_replica.cc:330] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:47.330298 8624 raft_consensus.cc:2229] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:47.331202 8624 raft_consensus.cc:2258] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:47.339527 8627 tablet_bootstrap.cc:654] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.342229 8636 tablet_bootstrap.cc:654] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.350414 8624 ts_tablet_manager.cc:1905] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:47.332510 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet ac608059319748a1b34510267c813f47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:47.350916 8692 raft_consensus.cc:482] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:47.351370 8692 raft_consensus.cc:504] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.352584 8625 tablet_replica.cc:330] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:47.353360 8625 raft_consensus.cc:2229] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:47.353850 8625 raft_consensus.cc:2258] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:47.356880 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3be82128696447e85758e8595b7e9e6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:47.358523 8278 leader_election.cc:341] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.359812 8692 leader_election.cc:288] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:47.361387 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3be82128696447e85758e8595b7e9e6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:47.361714 8623 ts_tablet_manager.cc:1428] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.085s user 0.008s sys 0.003s
I20260812 19:26:47.363845 8623 tablet_bootstrap.cc:492] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:47.365335 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet fb970cb3852940129aaefdc2208cf74d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:47.367111 8626 tablet_replica.cc:330] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:47.367830 8626 raft_consensus.cc:2229] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:47.368464 8626 raft_consensus.cc:2258] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:47.370445 8626 ts_tablet_manager.cc:1905] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:47.371016 8623 tablet_bootstrap.cc:654] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.367501 8691 raft_consensus.cc:504] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.378261 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1198960d8ea400387d189762d9549b6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:26:47.380035 8278 leader_election.cc:341] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.382465 8691 leader_election.cc:288] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:47.386363 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_9efc0be7968a4dd9be37db430fa9d5e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:47.388478 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9efc0be7968a4dd9be37db430fa9d5e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:47.388965 8281 leader_election.cc:341] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.388937 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e1198960d8ea400387d189762d9549b6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:47.389400 8281 leader_election.cc:302] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:47.389539 8180 raft_consensus.cc:3037] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.390378 8691 raft_consensus.cc:2726] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:47.395972 8180 raft_consensus.cc:2454] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:26:47.396646 8624 ts_tablet_manager.cc:1918] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 19:26:47.397040 8624 log.cc:1196] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/ac608059319748a1b34510267c813f47
I20260812 19:26:47.397964 8624 ts_tablet_manager.cc:1939] T ac608059319748a1b34510267c813f47 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:47.397666 8281 leader_election.cc:302] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:47.398859 8691 raft_consensus.cc:2781] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:47.400911 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]) successfully deleted
I20260812 19:26:47.404785 8625 ts_tablet_manager.cc:1905] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:47.411334 8623 tablet_bootstrap.cc:492] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.411985 8623 ts_tablet_manager.cc:1397] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.007s
I20260812 19:26:47.402104 8691 raft_consensus.cc:686] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:26:47.414376 8691 consensus_queue.cc:237] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.422802 8623 raft_consensus.cc:348] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.423648 8623 raft_consensus.cc:374] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.424000 8623 raft_consensus.cc:729] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.424845 8623 consensus_queue.cc:260] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.427515 8623 ts_tablet_manager.cc:1428] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20260812 19:26:47.428294 8623 tablet_bootstrap.cc:492] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:26:47.435129 7962 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 946ac8237fb5475cab84ce69180e13b0 has no consensus state
I20260812 19:26:47.453466 8623 tablet_bootstrap.cc:654] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.456957 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet ac608059319748a1b34510267c813f47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:47.463121 7945 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_3333c00eaad84adca3cfc46ecdae1d7b [id=3e92ad5d601b482aaabc37ffd7e7a9e7], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 2a43b5f9446b4ed4a0349af7d8c16f8f consensus state has no leader
I20260812 19:26:47.467110 8623 tablet_bootstrap.cc:492] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.467727 8623 ts_tablet_manager.cc:1397] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.040s user 0.012s sys 0.000s
I20260812 19:26:47.473871 8623 raft_consensus.cc:348] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.474897 8623 raft_consensus.cc:374] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.475237 8623 raft_consensus.cc:729] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.483801 8625 ts_tablet_manager.cc:1918] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 19:26:47.487066 8636 tablet_bootstrap.cc:492] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:47.487623 8636 ts_tablet_manager.cc:1397] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.303s user 0.007s sys 0.006s
I20260812 19:26:47.490132 8627 tablet_bootstrap.cc:492] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:47.490571 8627 ts_tablet_manager.cc:1397] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.184s user 0.025s sys 0.009s
I20260812 19:26:47.493026 8627 raft_consensus.cc:348] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.493710 8627 raft_consensus.cc:374] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.493986 8627 raft_consensus.cc:729] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.500571 8627 consensus_queue.cc:260] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.502605 8627 ts_tablet_manager.cc:1428] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20260812 19:26:47.503479 8627 tablet_bootstrap.cc:492] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:47.527809 7956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:47.529776 7956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:47.532567 8627 tablet_bootstrap.cc:654] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.555548 8333 tablet_service.cc:1467] Processing CreateTablet for tablet decf138a91394c939f686ff127ca7922 (DEFAULT_TABLE table=default.Table_8f4b0588af9946aa8241760c94c19731 [id=a42276cd79314914b1b737784de7fd98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.556748 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decf138a91394c939f686ff127ca7922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.562608 8494 tablet_service.cc:1467] Processing CreateTablet for tablet dab1e77a362d483788ac38318df3b58a (DEFAULT_TABLE table=default.Table_e010f3079ed44b45a4fc2e16e494a9aa [id=01ac43559ad945dd9d295920a14479ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.563829 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab1e77a362d483788ac38318df3b58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.565013 8492 tablet_service.cc:1467] Processing CreateTablet for tablet a1bd8f6905c24ae19c3370246028f7fd (DEFAULT_TABLE table=default.Table_23fba63fdbc84d25b260bc3ba2434a92 [id=3c0970afdc834aff921d14ba6ab03647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.566104 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1bd8f6905c24ae19c3370246028f7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.547669 7960 catalog_manager.cc:5495] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:47.572369 8329 tablet_service.cc:1467] Processing CreateTablet for tablet dab1e77a362d483788ac38318df3b58a (DEFAULT_TABLE table=default.Table_e010f3079ed44b45a4fc2e16e494a9aa [id=01ac43559ad945dd9d295920a14479ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.572886 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_3333c00eaad84adca3cfc46ecdae1d7b [id=3e92ad5d601b482aaabc37ffd7e7a9e7]). Expected version 2 got 0
I20260812 19:26:47.573526 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab1e77a362d483788ac38318df3b58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.577023 8330 tablet_service.cc:1467] Processing CreateTablet for tablet a1bd8f6905c24ae19c3370246028f7fd (DEFAULT_TABLE table=default.Table_23fba63fdbc84d25b260bc3ba2434a92 [id=3c0970afdc834aff921d14ba6ab03647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.578120 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1bd8f6905c24ae19c3370246028f7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.581019 8332 tablet_service.cc:1467] Processing CreateTablet for tablet 946ac8237fb5475cab84ce69180e13b0 (DEFAULT_TABLE table=default.Table_93219d4aa801471ab3650eb30f289b21 [id=1c3e047dba584132ba65b5c2db357a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.582108 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946ac8237fb5475cab84ce69180e13b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.582775 8495 tablet_service.cc:1467] Processing CreateTablet for tablet decf138a91394c939f686ff127ca7922 (DEFAULT_TABLE table=default.Table_8f4b0588af9946aa8241760c94c19731 [id=a42276cd79314914b1b737784de7fd98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.584643 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decf138a91394c939f686ff127ca7922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.585045 7954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8245870ce169462aae22b255c1803d28" } modify_external_catalogs: true
I20260812 19:26:47.585608 7954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8245870ce169462aae22b255c1803d28" } modify_external_catalogs: true
I20260812 19:26:47.592453 7952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet decf138a91394c939f686ff127ca7922
I20260812 19:26:47.595363 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44394
W20260812 19:26:47.596977 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet decf138a91394c939f686ff127ca7922 because the tablet was not found. No further retry: Not found: Tablet not found: decf138a91394c939f686ff127ca7922
I20260812 19:26:47.603055 7959 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_3333c00eaad84adca3cfc46ecdae1d7b [id=3e92ad5d601b482aaabc37ffd7e7a9e7]). Expected version 2 got 0
I20260812 19:26:47.615041 8356 raft_consensus.cc:1261] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Refusing update from remote peer 6a95b50ceede4dc99913aec28ddaa380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:26:47.618112 8626 ts_tablet_manager.cc:1918] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:47.618522 8626 log.cc:1196] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/fb970cb3852940129aaefdc2208cf74d
I20260812 19:26:47.619207 8626 ts_tablet_manager.cc:1939] T fb970cb3852940129aaefdc2208cf74d P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:47.619184 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet d3be82128696447e85758e8595b7e9e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:47.619380 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet ac608059319748a1b34510267c813f47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:47.620019 8624 tablet_replica.cc:330] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:47.620705 8624 raft_consensus.cc:2229] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:47.621131 8624 raft_consensus.cc:2258] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:47.623461 8624 ts_tablet_manager.cc:1905] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:47.490242 8636 raft_consensus.cc:348] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.629906 8636 raft_consensus.cc:374] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.630214 8636 raft_consensus.cc:729] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.632429 8328 tablet_service.cc:1467] Processing CreateTablet for tablet b961a688b260424499bef8e6bf62734f (DEFAULT_TABLE table=default.Table_089b7ab1b51d425788a8678f7d714ed6 [id=8ec4f22b4fa1428bba045191d2a9d169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.634550 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:47.635288 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 946ac8237fb5475cab84ce69180e13b0 (DEFAULT_TABLE table=default.Table_93219d4aa801471ab3650eb30f289b21 [id=1c3e047dba584132ba65b5c2db357a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.636631 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946ac8237fb5475cab84ce69180e13b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.641211 8490 tablet_service.cc:1467] Processing CreateTablet for tablet b961a688b260424499bef8e6bf62734f (DEFAULT_TABLE table=default.Table_089b7ab1b51d425788a8678f7d714ed6 [id=8ec4f22b4fa1428bba045191d2a9d169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.642375 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b961a688b260424499bef8e6bf62734f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.647716 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_972f4f7d001a49da90d12d0b96a2548e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:47.647925 8636 consensus_queue.cc:260] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:47.649500 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_972f4f7d001a49da90d12d0b96a2548e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:47.653007 8636 ts_tablet_manager.cc:1428] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.165s user 0.005s sys 0.001s
I20260812 19:26:47.654588 8624 ts_tablet_manager.cc:1918] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:47.655121 8624 log.cc:1196] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/d3be82128696447e85758e8595b7e9e6
I20260812 19:26:47.654918 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 538d05c5883d4575b8eb5d42dfb3c246 (DEFAULT_TABLE table=default.Table_49512314d04b46c2b5c304968d0426a4 [id=d8d745230100465d86d0374a29aabd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.655941 8624 ts_tablet_manager.cc:1939] T d3be82128696447e85758e8595b7e9e6 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:47.656714 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538d05c5883d4575b8eb5d42dfb3c246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.658813 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_9efc0be7968a4dd9be37db430fa9d5e8" } new_table_name: "default.Table_529a8f7f567641e381f494dc373c2182" modify_external_catalogs: true
I20260812 19:26:47.663079 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_4fce364e6d9545ae96b3b503b1fc5b71"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:47.666476 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 538d05c5883d4575b8eb5d42dfb3c246 (DEFAULT_TABLE table=default.Table_49512314d04b46c2b5c304968d0426a4 [id=d8d745230100465d86d0374a29aabd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.476047 8623 consensus_queue.cc:260] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.672883 8625 log.cc:1196] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/ac608059319748a1b34510267c813f47
I20260812 19:26:47.547298 8158 tablet_service.cc:1467] Processing CreateTablet for tablet decf138a91394c939f686ff127ca7922 (DEFAULT_TABLE table=default.Table_8f4b0588af9946aa8241760c94c19731 [id=a42276cd79314914b1b737784de7fd98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.548552 8157 tablet_service.cc:1467] Processing CreateTablet for tablet dab1e77a362d483788ac38318df3b58a (DEFAULT_TABLE table=default.Table_e010f3079ed44b45a4fc2e16e494a9aa [id=01ac43559ad945dd9d295920a14479ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.674374 8623 ts_tablet_manager.cc:1428] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.206s user 0.008s sys 0.001s
I20260812 19:26:47.674716 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dab1e77a362d483788ac38318df3b58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.675218 8623 tablet_bootstrap.cc:492] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:47.565583 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 946ac8237fb5475cab84ce69180e13b0 (DEFAULT_TABLE table=default.Table_93219d4aa801471ab3650eb30f289b21 [id=1c3e047dba584132ba65b5c2db357a33]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.678474 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 946ac8237fb5475cab84ce69180e13b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.680495 8623 tablet_bootstrap.cc:654] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.566776 8156 tablet_service.cc:1467] Processing CreateTablet for tablet b961a688b260424499bef8e6bf62734f (DEFAULT_TABLE table=default.Table_089b7ab1b51d425788a8678f7d714ed6 [id=8ec4f22b4fa1428bba045191d2a9d169]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.681499 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b961a688b260424499bef8e6bf62734f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.682986 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b961a688b260424499bef8e6bf62734f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.687511 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet decf138a91394c939f686ff127ca7922. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.688941 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538d05c5883d4575b8eb5d42dfb3c246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.691972 8623 tablet_bootstrap.cc:492] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.692409 8623 ts_tablet_manager.cc:1397] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.012s
I20260812 19:26:47.568998 8155 tablet_service.cc:1467] Processing CreateTablet for tablet a1bd8f6905c24ae19c3370246028f7fd (DEFAULT_TABLE table=default.Table_23fba63fdbc84d25b260bc3ba2434a92 [id=3c0970afdc834aff921d14ba6ab03647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.694274 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a1bd8f6905c24ae19c3370246028f7fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.695392 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet d3be82128696447e85758e8595b7e9e6 (table default.Table_720375e2fa9e4667955d0ee24a1e09e9 [id=a50462e739154544ba191948a1e77814]) successfully deleted
I20260812 19:26:47.594956 8153 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:47.617518 8701 consensus_queue.cc:1035] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:26:47.616035 8107 consensus_peers.cc:487] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:47.696483 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet ac608059319748a1b34510267c813f47 because the tablet was not found. No further retry: Not found: Tablet not found: ac608059319748a1b34510267c813f47
W20260812 19:26:47.696838 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 81116.3us
I20260812 19:26:47.628108 8152 tablet_service.cc:1467] Processing CreateTablet for tablet 538d05c5883d4575b8eb5d42dfb3c246 (DEFAULT_TABLE table=default.Table_49512314d04b46c2b5c304968d0426a4 [id=d8d745230100465d86d0374a29aabd7c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:47.697608 8623 raft_consensus.cc:348] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.698427 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 538d05c5883d4575b8eb5d42dfb3c246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:47.698503 8623 raft_consensus.cc:374] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.698964 8623 raft_consensus.cc:729] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.699810 8623 consensus_queue.cc:260] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.643558 8149 tablet_service.cc:1514] Processing DeleteTablet for tablet 719b756d5db14d61948280d42a42234a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:47.644685 8151 tablet_service.cc:1514] Processing DeleteTablet for tablet b24558d110b044a58a0d31b9b9a16362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:47.645606 8148 tablet_service.cc:1514] Processing DeleteTablet for tablet ef215230eb7e456b8c3ec35f13c06920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:47.647467 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bcf8d54395461d9eb07965966153a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:47.647677 8675 raft_consensus.cc:482] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:47.701682 8675 raft_consensus.cc:504] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.702150 8623 ts_tablet_manager.cc:1428] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20260812 19:26:47.702941 8623 tablet_bootstrap.cc:492] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:47.703459 8675 leader_election.cc:288] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
W20260812 19:26:47.716526 8108 leader_election.cc:341] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 33bcf8d54395461d9eb07965966153a1
W20260812 19:26:47.680045 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4fce364e6d9545ae96b3b503b1fc5b71 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:47.724148 8623 tablet_bootstrap.cc:654] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.745620 8691 raft_consensus.cc:482] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:47.746110 8691 raft_consensus.cc:504] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.748006 8691 leader_election.cc:288] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:47.750267 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "650cd08798724b6cb5f7026cd0631b65" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:47.751138 8180 raft_consensus.cc:2454] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:26:47.752562 8281 leader_election.cc:302] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:47.764990 8691 raft_consensus.cc:2781] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:47.765353 8691 raft_consensus.cc:482] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:47.765657 8691 raft_consensus.cc:3037] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.772089 8691 raft_consensus.cc:504] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.783396 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "650cd08798724b6cb5f7026cd0631b65" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:47.784158 8180 raft_consensus.cc:3037] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.785705 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_140dbc4b9a1741f0b88729780e07cfd2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:47.787570 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_140dbc4b9a1741f0b88729780e07cfd2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:47.788278 8691 leader_election.cc:288] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:47.792579 8180 raft_consensus.cc:2454] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:26:47.792594 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_61a5cdb267bc48488c3252251f1e139a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:47.793756 7954 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 490dece0ae9f4214b39398fa25653560
I20260812 19:26:47.793839 8281 leader_election.cc:302] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:26:47.794546 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61a5cdb267bc48488c3252251f1e139a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:47.800474 7954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_4219b6e538dd4ae38c115865affc34be" } modify_external_catalogs: true
I20260812 19:26:47.801064 7954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_4219b6e538dd4ae38c115865affc34be" } modify_external_catalogs: true
I20260812 19:26:47.804988 8691 raft_consensus.cc:2781] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:47.806267 8691 raft_consensus.cc:686] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
W20260812 19:26:47.818389 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5bfebac9602f494eb19772589992f888 has no consensus state
I20260812 19:26:47.818859 8691 consensus_queue.cc:237] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.846390 8627 tablet_bootstrap.cc:492] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:47.846834 8627 ts_tablet_manager.cc:1397] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.344s user 0.040s sys 0.084s
I20260812 19:26:47.849864 8627 raft_consensus.cc:348] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.850626 8627 raft_consensus.cc:374] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.850869 8627 raft_consensus.cc:729] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.854799 8627 consensus_queue.cc:260] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.858628 8627 ts_tablet_manager.cc:1428] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
W20260812 19:26:47.859290 7945 consensus_peers.cc:487] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 -> Peer 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563): Couldn't send request to peer 1e9a660a0f1e4fc6bc6335b38eece0bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 19:26:47.859604 8627 tablet_bootstrap.cc:492] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:47.859613 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33bcf8d54395461d9eb07965966153a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:47.860387 8516 raft_consensus.cc:2454] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:47.864611 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "650cd08798724b6cb5f7026cd0631b65" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:47.865613 8623 tablet_bootstrap.cc:492] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.865898 8627 tablet_bootstrap.cc:654] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.866047 8623 ts_tablet_manager.cc:1397] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.163s user 0.039s sys 0.071s
I20260812 19:26:47.868592 8623 raft_consensus.cc:348] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.869278 8623 raft_consensus.cc:374] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.869537 8623 raft_consensus.cc:729] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.869951 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bcf8d54395461d9eb07965966153a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:47.870159 8623 consensus_queue.cc:260] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.871075 8107 leader_election.cc:302] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:47.872144 8623 ts_tablet_manager.cc:1428] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260812 19:26:47.872490 8675 raft_consensus.cc:2781] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:47.872799 8675 raft_consensus.cc:482] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:47.873108 8675 raft_consensus.cc:3037] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.873288 8623 tablet_bootstrap.cc:492] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:47.877547 8627 tablet_bootstrap.cc:492] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:47.878012 8627 ts_tablet_manager.cc:1397] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.003s
I20260812 19:26:47.878350 8623 tablet_bootstrap.cc:654] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:47.879768 8278 leader_election.cc:341] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.881189 8627 raft_consensus.cc:348] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.882031 8627 raft_consensus.cc:374] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.882328 8627 raft_consensus.cc:729] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.882933 8627 consensus_queue.cc:260] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.885337 8627 ts_tablet_manager.cc:1428] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s
I20260812 19:26:47.886884 8627 tablet_bootstrap.cc:492] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:47.891965 8627 tablet_bootstrap.cc:654] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:47.894632 8623 tablet_bootstrap.cc:492] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:47.895159 8623 ts_tablet_manager.cc:1397] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.022s user 0.017s sys 0.002s
I20260812 19:26:47.899240 8636 tablet_bootstrap.cc:492] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:47.888128 8675 raft_consensus.cc:504] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.673728 8625 ts_tablet_manager.cc:1939] T ac608059319748a1b34510267c813f47 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:47.700784 8648 raft_consensus.cc:482] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:47.903564 8648 raft_consensus.cc:504] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:47.903895 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "650cd08798724b6cb5f7026cd0631b65" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:47.905663 8648 leader_election.cc:288] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:47.903590 8623 raft_consensus.cc:348] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.907248 8623 raft_consensus.cc:374] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:47.907514 8623 raft_consensus.cc:729] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:47.907702 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef215230eb7e456b8c3ec35f13c06920" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:47.908094 8623 consensus_queue.cc:260] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:47.909060 8107 leader_election.cc:341] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.924871 8675 leader_election.cc:288] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
W20260812 19:26:47.927848 8108 leader_election.cc:341] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 33bcf8d54395461d9eb07965966153a1
W20260812 19:26:47.929766 8278 leader_election.cc:341] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:47.930807 8108 leader_election.cc:341] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: ef215230eb7e456b8c3ec35f13c06920
I20260812 19:26:47.931223 8108 leader_election.cc:302] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:47.932003 8623 ts_tablet_manager.cc:1428] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.037s user 0.008s sys 0.000s
I20260812 19:26:47.935361 7953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_5f3b3da73f7c4eed96a5b76480cabbf0" } new_table_name: "default.Table_7e451ef9f71049ddb6e99c4b2fe2c86b" modify_external_catalogs: true
I20260812 19:26:47.950428 8675 raft_consensus.cc:2726] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:47.952026 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33bcf8d54395461d9eb07965966153a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:47.952648 8516 raft_consensus.cc:3037] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:47.954914 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet fb970cb3852940129aaefdc2208cf74d (table default.Table_352f3e372ef2499faa65351a421cb72b [id=8babc41fda134da8987a2060959eed16]) successfully deleted
I20260812 19:26:47.956108 8626 tablet_replica.cc:330] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:47.957180 8626 raft_consensus.cc:2229] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:47.958063 8626 raft_consensus.cc:2258] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:47.974025 8691 raft_consensus.cc:482] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:47.974505 8691 raft_consensus.cc:504] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:47.976573 8691 leader_election.cc:288] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:47.979228 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336e05589e784e768695439e7dc93b71" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:47.980964 8278 leader_election.cc:341] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:47.985783 7954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet baf3e61bb2ab45d19d3ed0169f0a6cdb
I20260812 19:26:47.987340 8516 raft_consensus.cc:2454] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:47.993031 8107 leader_election.cc:302] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:47.997146 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336e05589e784e768695439e7dc93b71" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:47.997931 8180 raft_consensus.cc:2454] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:26:47.998486 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:47.998996 8675 raft_consensus.cc:2781] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:47.999332 8281 leader_election.cc:302] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:47.999564 8675 raft_consensus.cc:686] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:48.000903 7962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_93219d4aa801471ab3650eb30f289b21" } modify_external_catalogs: true
I20260812 19:26:48.000708 8675 consensus_queue.cc:237] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.001580 7962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_93219d4aa801471ab3650eb30f289b21" } modify_external_catalogs: true
I20260812 19:26:48.003553 8691 raft_consensus.cc:2781] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:48.003979 8691 raft_consensus.cc:482] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:48.004400 8691 raft_consensus.cc:3037] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:48.013945 8691 raft_consensus.cc:504] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.019568 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336e05589e784e768695439e7dc93b71" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:26:48.022006 8278 leader_election.cc:341] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.022504 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336e05589e784e768695439e7dc93b71" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:48.023466 8180 raft_consensus.cc:3037] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:48.024044 8691 leader_election.cc:288] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:48.030833 8626 ts_tablet_manager.cc:1905] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:48.035171 7954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_140dbc4b9a1741f0b88729780e07cfd2" } new_table_name: "default.Table_0c23725418434d109d96642b5fe3b47b" modify_external_catalogs: true
I20260812 19:26:48.041381 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_9c9d2b97c285484a900a37c33effcecb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:48.045898 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_ef547861981d429baacbb9286c8fc629"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:48.050535 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:48.051892 8624 tablet_replica.cc:330] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:48.052722 8624 raft_consensus.cc:2229] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:48.053174 8624 raft_consensus.cc:2258] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:48.053689 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:48.055645 8624 ts_tablet_manager.cc:1905] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:48.079535 8648 raft_consensus.cc:482] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.080094 8648 raft_consensus.cc:504] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.084741 8624 ts_tablet_manager.cc:1918] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
W20260812 19:26:48.084734 8108 leader_election.cc:341] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 719b756d5db14d61948280d42a42234a
I20260812 19:26:48.085131 8624 log.cc:1196] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/baf3e61bb2ab45d19d3ed0169f0a6cdb
I20260812 19:26:48.085765 8624 ts_tablet_manager.cc:1939] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:48.086270 8648 leader_election.cc:288] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:48.084765 8627 tablet_bootstrap.cc:492] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:48.088302 8627 ts_tablet_manager.cc:1397] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.202s user 0.054s sys 0.092s
I20260812 19:26:48.088220 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "719b756d5db14d61948280d42a42234a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:48.089797 8107 leader_election.cc:341] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.091022 8627 raft_consensus.cc:348] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.090790 8107 leader_election.cc:302] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:48.091722 8627 raft_consensus.cc:374] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.091977 8627 raft_consensus.cc:729] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.092617 8627 consensus_queue.cc:260] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.094837 8627 ts_tablet_manager.cc:1428] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260812 19:26:48.093223 8648 raft_consensus.cc:2726] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:48.094988 8636 tablet_bootstrap.cc:654] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.098017 8623 tablet_bootstrap.cc:492] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:48.088358 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet baf3e61bb2ab45d19d3ed0169f0a6cdb (table default.Table_4219b6e538dd4ae38c115865affc34be [id=09aaec16deb046efb62c0b8f6f3b0ea6]) successfully deleted
W20260812 19:26:48.110567 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9c9d2b97c285484a900a37c33effcecb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:48.110767 8627 tablet_bootstrap.cc:492] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:26:48.112727 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ef547861981d429baacbb9286c8fc629 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:48.133965 7953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61fce7b5a9d84718a1ed252f9f5f91d9 has no consensus state
I20260812 19:26:48.142712 8701 raft_consensus.cc:482] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.143316 8701 raft_consensus.cc:504] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.148515 8701 leader_election.cc:288] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:48.150720 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf3e61bb2ab45d19d3ed0169f0a6cdb" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:48.153038 8107 leader_election.cc:341] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.153518 8636 tablet_bootstrap.cc:492] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:48.154255 8636 ts_tablet_manager.cc:1397] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.255s user 0.010s sys 0.009s
I20260812 19:26:48.166102 8636 raft_consensus.cc:348] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.167411 8636 raft_consensus.cc:374] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.170660 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_659a9b2148dd4d55a121a8c2e0a5881a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:48.174013 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_659a9b2148dd4d55a121a8c2e0a5881a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:48.167922 8636 raft_consensus.cc:729] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.186147 8636 consensus_queue.cc:260] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.171054 8729 tablet.cc:1722] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260812 19:26:48.188119 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_3450db0f15ec43dfb63b86b025614242"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:48.191190 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3450db0f15ec43dfb63b86b025614242 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:48.194970 8627 tablet_bootstrap.cc:654] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.195740 8636 ts_tablet_manager.cc:1428] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.041s user 0.008s sys 0.011s
I20260812 19:26:48.198668 8636 tablet_bootstrap.cc:492] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:48.198472 8730 tablet.cc:1722] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260812 19:26:48.201792 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_089b7ab1b51d425788a8678f7d714ed6" } modify_external_catalogs: true
I20260812 19:26:48.202381 8180 raft_consensus.cc:2454] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:26:48.202613 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_089b7ab1b51d425788a8678f7d714ed6" } modify_external_catalogs: true
W20260812 19:26:48.210223 8108 leader_election.cc:341] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: baf3e61bb2ab45d19d3ed0169f0a6cdb
I20260812 19:26:48.210980 8108 leader_election.cc:302] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:48.213867 8648 raft_consensus.cc:2726] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:48.214490 8625 tablet_replica.cc:330] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:48.216415 8625 raft_consensus.cc:2229] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:48.217144 8625 raft_consensus.cc:2258] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:48.217419 8691 raft_consensus.cc:482] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.218106 8691 raft_consensus.cc:504] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.232795 8691 leader_election.cc:288] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:48.234239 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet b24558d110b044a58a0d31b9b9a16362 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:48.240406 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decf138a91394c939f686ff127ca7922" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:48.242262 8278 leader_election.cc:341] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.256037 8636 tablet_bootstrap.cc:654] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.265439 8626 ts_tablet_manager.cc:1918] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 19:26:48.266188 8626 log.cc:1196] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/ac608059319748a1b34510267c813f47
I20260812 19:26:48.267606 8626 ts_tablet_manager.cc:1939] T ac608059319748a1b34510267c813f47 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:48.272429 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]) successfully deleted
I20260812 19:26:48.274080 8623 tablet_bootstrap.cc:654] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.276633 8281 leader_election.cc:302] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:48.280460 8691 raft_consensus.cc:2781] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:48.281141 8691 raft_consensus.cc:686] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:26:48.282539 8691 consensus_queue.cc:237] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.287705 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decf138a91394c939f686ff127ca7922" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:48.289850 8281 leader_election.cc:341] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.290535 8281 leader_election.cc:302] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:48.292368 8692 raft_consensus.cc:2726] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:48.298870 8627 tablet_bootstrap.cc:492] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:48.299291 8627 ts_tablet_manager.cc:1397] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.193s user 0.012s sys 0.020s
I20260812 19:26:48.302497 8627 raft_consensus.cc:348] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.303206 8627 raft_consensus.cc:374] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.303517 8627 raft_consensus.cc:729] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.291941 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet ac608059319748a1b34510267c813f47 (table default.Table_e0736121494346cc84c7333ef09a8697 [id=027ee2c03b3e4d699438a0d9ee82ff12]) successfully deleted
I20260812 19:26:48.304136 8627 consensus_queue.cc:260] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.307937 8627 ts_tablet_manager.cc:1428] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.008s user 0.001s sys 0.005s
W20260812 19:26:48.308029 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet decf138a91394c939f686ff127ca7922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet decf138a91394c939f686ff127ca7922 already in progress: creating tablet
I20260812 19:26:48.309139 8627 tablet_bootstrap.cc:492] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:48.319387 8636 tablet_bootstrap.cc:492] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:48.319940 8636 ts_tablet_manager.cc:1397] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.123s user 0.016s sys 0.009s
I20260812 19:26:48.324379 8625 ts_tablet_manager.cc:1905] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:48.325074 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet decf138a91394c939f686ff127ca7922 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet decf138a91394c939f686ff127ca7922 already in progress: creating tablet
I20260812 19:26:48.327514 8626 tablet_replica.cc:330] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:48.328704 8626 raft_consensus.cc:2229] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:48.329494 8626 raft_consensus.cc:2258] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:48.330710 8636 raft_consensus.cc:348] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.339541 8623 tablet_bootstrap.cc:492] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:48.340039 8623 ts_tablet_manager.cc:1397] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.252s user 0.012s sys 0.013s
I20260812 19:26:48.339380 7955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_bd975858d3874a0fb3e63c85fd13be32" } new_table_name: "default.Table_26456d69980b4cbe8f39b8d7c9592701" modify_external_catalogs: true
I20260812 19:26:48.344662 8627 tablet_bootstrap.cc:654] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.347584 8636 raft_consensus.cc:374] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.349436 8729 tablet.cc:1717] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Skipping requested alter to schema version 3, tablet already version 3
I20260812 19:26:48.347913 8636 raft_consensus.cc:729] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.351034 8636 consensus_queue.cc:260] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.358218 8730 tablet.cc:1717] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Skipping requested alter to schema version 3, tablet already version 3
I20260812 19:26:48.357528 8623 raft_consensus.cc:348] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.362303 8623 raft_consensus.cc:374] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.362555 8623 raft_consensus.cc:729] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.363242 8623 consensus_queue.cc:260] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.366338 8623 ts_tablet_manager.cc:1428] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.026s user 0.003s sys 0.003s
I20260812 19:26:48.367218 8623 tablet_bootstrap.cc:492] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:26:48.374037 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 63928.5us
I20260812 19:26:48.375685 8731 raft_consensus.cc:482] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.376215 8731 raft_consensus.cc:504] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.379613 8625 ts_tablet_manager.cc:1918] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:48.380036 8625 log.cc:1196] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/719b756d5db14d61948280d42a42234a
W20260812 19:26:48.374514 7954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 1950030ab501429a91971f80f761a172 has no consensus state
I20260812 19:26:48.388506 8731 leader_election.cc:288] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:48.417598 8625 ts_tablet_manager.cc:1939] T 719b756d5db14d61948280d42a42234a P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:48.420114 8625 tablet_replica.cc:330] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:48.420990 8625 raft_consensus.cc:2229] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:48.421553 8625 raft_consensus.cc:2258] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:48.422653 8623 tablet_bootstrap.cc:654] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.429841 8625 ts_tablet_manager.cc:1905] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:48.429893 8636 ts_tablet_manager.cc:1428] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.106s user 0.009s sys 0.009s
I20260812 19:26:48.437244 8636 tablet_bootstrap.cc:492] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:48.442411 8636 tablet_bootstrap.cc:654] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.462219 8636 tablet_bootstrap.cc:492] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:48.462641 8636 ts_tablet_manager.cc:1397] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.000s
I20260812 19:26:48.467828 8636 raft_consensus.cc:348] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.468557 8636 raft_consensus.cc:374] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.468806 8636 raft_consensus.cc:729] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.469386 8636 consensus_queue.cc:260] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.470557 7956 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:48.478049 7960 catalog_manager.cc:5495] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:48.479674 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:48.486282 8328 tablet_service.cc:1467] Processing CreateTablet for tablet f313502f35a046188c4b24c10b762c7b (DEFAULT_TABLE table=default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d [id=54b1f58892924c83a98dd0761039f77d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.487768 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f313502f35a046188c4b24c10b762c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.486282 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfebac9602f494eb19772589992f888 (DEFAULT_TABLE table=default.Table_529a8f7f567641e381f494dc373c2182 [id=f53979057a0b4180a028a935227c80bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.493585 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfebac9602f494eb19772589992f888. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:48.500718 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 19) took 836 ms (client timeout 1000 ms). Trace:
W20260812 19:26:48.501144 7956 rpcz_store.cc:269] 0812 19:26:47.664185 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:47.664331 (+ 146us) service_pool.cc:227] Handling call
0812 19:26:48.500645 (+836314us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3}
I20260812 19:26:48.509018 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 355b9f4f5ada428789aa871c888843e1 (DEFAULT_TABLE table=default.Table_efbd37ddd76e44dcb7b965fc04ea412b [id=3c820f17d99d4f09ad27e0f18e4bb569]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.510144 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355b9f4f5ada428789aa871c888843e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.510281 8636 ts_tablet_manager.cc:1428] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.044s user 0.005s sys 0.000s
I20260812 19:26:48.507915 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (DEFAULT_TABLE table=default.Table_7e451ef9f71049ddb6e99c4b2fe2c86b [id=ed0a6de9012a40f182525359155bfe9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.513212 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61fce7b5a9d84718a1ed252f9f5f91d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.512732 8636 tablet_bootstrap.cc:492] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:48.513031 7956 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_63698336eb614df88eca5031884199fd [id=3e92ad5d601b482aaabc37ffd7e7a9e7]). Expected version 3 got 0
I20260812 19:26:48.526573 8636 tablet_bootstrap.cc:654] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.528776 8626 ts_tablet_manager.cc:1905] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:48.535138 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 73656.8us
I20260812 19:26:48.538550 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 719b756d5db14d61948280d42a42234a (table default.Table_cfb4d04872c64c22a0d2f4519acab91d [id=93e1bfb55e0448178d16c0c7b724eeaa]) successfully deleted
W20260812 19:26:48.547360 8278 consensus_peers.cc:487] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:48.546008 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_63698336eb614df88eca5031884199fd [id=3e92ad5d601b482aaabc37ffd7e7a9e7]). Expected version 3 got 0
I20260812 19:26:48.560613 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet ef215230eb7e456b8c3ec35f13c06920 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:48.569593 8495 tablet_service.cc:1467] Processing CreateTablet for tablet f313502f35a046188c4b24c10b762c7b (DEFAULT_TABLE table=default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d [id=54b1f58892924c83a98dd0761039f77d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.571493 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f313502f35a046188c4b24c10b762c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.577677 8627 tablet_bootstrap.cc:492] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:48.578197 8627 ts_tablet_manager.cc:1397] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.269s user 0.023s sys 0.051s
W20260812 19:26:48.584827 7948 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5bfebac9602f494eb19772589992f888 (table default.Table_529a8f7f567641e381f494dc373c2182 [id=f53979057a0b4180a028a935227c80bb], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5bfebac9602f494eb19772589992f888 consensus state has no leader
I20260812 19:26:48.590613 8727 raft_consensus.cc:482] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.583940 8627 raft_consensus.cc:348] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.591336 8627 raft_consensus.cc:374] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.591635 8627 raft_consensus.cc:729] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.591404 8727 raft_consensus.cc:504] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:48.595281 8443 leader_election.cc:341] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: b24558d110b044a58a0d31b9b9a16362
I20260812 19:26:48.592541 8627 consensus_queue.cc:260] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.602054 8627 ts_tablet_manager.cc:1428] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.024s user 0.011s sys 0.000s
I20260812 19:26:48.603134 8627 tablet_bootstrap.cc:492] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:48.604750 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b24558d110b044a58a0d31b9b9a16362" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:48.608047 8446 leader_election.cc:341] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: Tablet not RUNNING: STOPPED
I20260812 19:26:48.610667 8446 leader_election.cc:302] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:48.613461 8731 raft_consensus.cc:2726] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:48.617276 8691 consensus_queue.cc:1035] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:26:48.622107 8108 leader_election.cc:341] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: d3be82128696447e85758e8595b7e9e6
I20260812 19:26:48.627322 8154 tablet_service.cc:1467] Processing CreateTablet for tablet f313502f35a046188c4b24c10b762c7b (DEFAULT_TABLE table=default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d [id=54b1f58892924c83a98dd0761039f77d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.629777 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfebac9602f494eb19772589992f888 (DEFAULT_TABLE table=default.Table_529a8f7f567641e381f494dc373c2182 [id=f53979057a0b4180a028a935227c80bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.630378 8675 raft_consensus.cc:482] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.631656 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfebac9602f494eb19772589992f888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.631032 8675 raft_consensus.cc:504] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.633558 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet ac608059319748a1b34510267c813f47 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:48.635856 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f313502f35a046188c4b24c10b762c7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.636163 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1bd8f6905c24ae19c3370246028f7fd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:48.637272 8356 raft_consensus.cc:2454] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:48.638972 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (DEFAULT_TABLE table=default.Table_7e451ef9f71049ddb6e99c4b2fe2c86b [id=ed0a6de9012a40f182525359155bfe9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.639572 8108 leader_election.cc:302] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:48.640792 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61fce7b5a9d84718a1ed252f9f5f91d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.641215 8648 raft_consensus.cc:2781] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:48.641884 8648 raft_consensus.cc:482] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:48.642475 8648 raft_consensus.cc:3037] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:48.647126 8675 leader_election.cc:288] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
W20260812 19:26:48.654544 7955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 650cd08798724b6cb5f7026cd0631b65 consensus state has no leader
I20260812 19:26:48.654469 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 355b9f4f5ada428789aa871c888843e1 (DEFAULT_TABLE table=default.Table_efbd37ddd76e44dcb7b965fc04ea412b [id=3c820f17d99d4f09ad27e0f18e4bb569]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.655112 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1bd8f6905c24ae19c3370246028f7fd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:48.657910 8107 leader_election.cc:341] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.660046 8627 tablet_bootstrap.cc:654] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.665825 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355b9f4f5ada428789aa871c888843e1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:48.671510 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 21) took 926 ms (client timeout 1000 ms). Trace:
I20260812 19:26:48.676497 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet b961a688b260424499bef8e6bf62734f
I20260812 19:26:48.681828 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet b961a688b260424499bef8e6bf62734f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:48 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:48.690198 8727 leader_election.cc:288] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:48.692226 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3be82128696447e85758e8595b7e9e6" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:48.694351 7962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 946ac8237fb5475cab84ce69180e13b0
W20260812 19:26:48.696448 8107 leader_election.cc:341] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.696806 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet b961a688b260424499bef8e6bf62734f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:48 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:48.697204 8107 leader_election.cc:302] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:48.697574 8727 raft_consensus.cc:482] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.698505 8675 raft_consensus.cc:2726] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:48.698287 8727 raft_consensus.cc:504] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.703555 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet 946ac8237fb5475cab84ce69180e13b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:48.705113 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 946ac8237fb5475cab84ce69180e13b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:48.716996 8627 tablet_bootstrap.cc:492] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:48.717557 8627 ts_tablet_manager.cc:1397] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.115s user 0.013s sys 0.013s
I20260812 19:26:48.717589 8490 tablet_service.cc:1467] Processing CreateTablet for tablet 5bfebac9602f494eb19772589992f888 (DEFAULT_TABLE table=default.Table_529a8f7f567641e381f494dc373c2182 [id=f53979057a0b4180a028a935227c80bb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.720096 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bfebac9602f494eb19772589992f888. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:48.671983 7960 rpcz_store.cc:269] 0812 19:26:47.745285 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:47.745439 (+ 154us) service_pool.cc:227] Handling call
0812 19:26:47.784932 (+ 39493us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:48.671398 (+886466us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:48.495648 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:48.495998 (+ 350us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:48.496022 (+ 24us) write_op.cc:435] Acquired schema lock
0812 19:26:48.496034 (+ 12us) tablet.cc:660] Decoding operations
0812 19:26:48.496298 (+ 264us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:48.496348 (+ 50us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:48.496381 (+ 33us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:48.496571 (+ 190us) tablet.cc:699] Row locks acquired
0812 19:26:48.496591 (+ 20us) write_op.cc:260] PREPARE: finished
0812 19:26:48.496726 (+ 135us) write_op.cc:270] Start()
0812 19:26:48.496841 (+ 115us) write_op.cc:276] Timestamp: P: 1786562808496658 usec, L: 0
0812 19:26:48.496864 (+ 23us) op_driver.cc:331] REPLICATION: starting
0812 19:26:48.497413 (+ 549us) log.cc:842] Serialized 532 byte log entry
0812 19:26:48.660273 (+162860us) op_driver.cc:444] REPLICATION: finished
0812 19:26:48.660683 (+ 410us) write_op.cc:301] APPLY: starting
0812 19:26:48.660809 (+ 126us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:48.660929 (+ 120us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:48.661158 (+ 229us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:48.661398 (+ 240us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:48.661981 (+ 583us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:48.662077 (+ 96us) write_op.cc:312] APPLY: finished
0812 19:26:48.662323 (+ 246us) log.cc:842] Serialized 22 byte log entry
0812 19:26:48.662550 (+ 227us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:48.662642 (+ 92us) write_op.cc:454] Released schema lock
0812 19:26:48.662682 (+ 40us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:48.663021 (+ 339us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:48.663105 (+ 84us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":87367936,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":2537,"apply.run_wall_time_us":2772,"num_ops":1,"prepare.queue_time_us":118,"prepare.run_cpu_time_us":1944,"prepare.run_wall_time_us":1944,"replication_time_us":163303}]]}
I20260812 19:26:48.743391 8627 raft_consensus.cc:348] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.744424 8627 raft_consensus.cc:374] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.744741 8627 raft_consensus.cc:729] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.745525 8627 consensus_queue.cc:260] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.751216 8626 ts_tablet_manager.cc:1918] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:48.759578 8626 log.cc:1196] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/33bcf8d54395461d9eb07965966153a1
I20260812 19:26:48.762342 8748 tablet_replica.cc:330] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:48.763799 8626 ts_tablet_manager.cc:1939] T 33bcf8d54395461d9eb07965966153a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:48.767838 8627 ts_tablet_manager.cc:1428] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.050s user 0.011s sys 0.004s
I20260812 19:26:48.769619 8748 raft_consensus.cc:2229] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:48.780340 8748 raft_consensus.cc:2258] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:48.780939 8627 tablet_bootstrap.cc:492] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:48.788049 8626 tablet_replica.cc:330] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:48.790128 8648 raft_consensus.cc:504] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.793332 8748 ts_tablet_manager.cc:1905] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:48.794643 8623 tablet_bootstrap.cc:492] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:48.795022 8623 ts_tablet_manager.cc:1397] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.428s user 0.010s sys 0.007s
I20260812 19:26:48.799530 8626 raft_consensus.cc:2229] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:48.802019 8626 raft_consensus.cc:2258] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:48.755184 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet b961a688b260424499bef8e6bf62734f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b961a688b260424499bef8e6bf62734f already in progress: creating tablet
W20260812 19:26:48.811354 7946 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 56237us
I20260812 19:26:48.818231 8636 tablet_bootstrap.cc:492] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:48.818687 8636 ts_tablet_manager.cc:1397] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.306s user 0.032s sys 0.019s
I20260812 19:26:48.823350 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (DEFAULT_TABLE table=default.Table_7e451ef9f71049ddb6e99c4b2fe2c86b [id=ed0a6de9012a40f182525359155bfe9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.824937 8627 tablet_bootstrap.cc:654] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:48.828133 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61fce7b5a9d84718a1ed252f9f5f91d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.828728 8626 ts_tablet_manager.cc:1905] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:48.825815 8492 tablet_service.cc:1467] Processing CreateTablet for tablet 355b9f4f5ada428789aa871c888843e1 (DEFAULT_TABLE table=default.Table_efbd37ddd76e44dcb7b965fc04ea412b [id=3c820f17d99d4f09ad27e0f18e4bb569]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.830611 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 355b9f4f5ada428789aa871c888843e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.844353 8727 leader_election.cc:288] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:48.870556 8636 raft_consensus.cc:348] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.871574 8748 ts_tablet_manager.cc:1918] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:48.880386 8636 raft_consensus.cc:374] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.880718 8636 raft_consensus.cc:729] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.881461 8636 consensus_queue.cc:260] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.884238 8636 ts_tablet_manager.cc:1428] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.065s user 0.005s sys 0.005s
I20260812 19:26:48.885140 8636 tablet_bootstrap.cc:492] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:26:48.888595 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 66540.7us
I20260812 19:26:48.893870 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 68583d63475a495ca97f3221825622e2 (DEFAULT_TABLE table=default.Table_9c9d2b97c285484a900a37c33effcecb [id=0479fcb4d0ff44bd98ce28beddd898be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.895008 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68583d63475a495ca97f3221825622e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.896804 8748 log.cc:1196] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/946ac8237fb5475cab84ce69180e13b0
I20260812 19:26:48.897778 8748 ts_tablet_manager.cc:1939] T 946ac8237fb5475cab84ce69180e13b0 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:48.905167 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet b961a688b260424499bef8e6bf62734f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:48 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:48.906440 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet 946ac8237fb5475cab84ce69180e13b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:48.931488 8152 tablet_service.cc:1467] Processing CreateTablet for tablet 68583d63475a495ca97f3221825622e2 (DEFAULT_TABLE table=default.Table_9c9d2b97c285484a900a37c33effcecb [id=0479fcb4d0ff44bd98ce28beddd898be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.933538 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538d05c5883d4575b8eb5d42dfb3c246" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:48.937148 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 33bcf8d54395461d9eb07965966153a1 (table default.Table_2d1f3cf019494f3ba9e1aa5492599638 [id=86f25ffe25e341069e55a288d5c0d998]) successfully deleted
I20260812 19:26:48.945219 8636 tablet_bootstrap.cc:654] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:48.946154 8107 leader_election.cc:341] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:48.955456 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 77445461e7f24c1e80bedb96b2af5daf (DEFAULT_TABLE table=default.Table_3450db0f15ec43dfb63b86b025614242 [id=23c4b17280f540ddacaf2fe8b08715c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.899820 8627 tablet_bootstrap.cc:492] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:48.931278 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538d05c5883d4575b8eb5d42dfb3c246" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:48.962738 8627 ts_tablet_manager.cc:1397] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.187s user 0.012s sys 0.033s
I20260812 19:26:48.962826 8356 raft_consensus.cc:2454] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:26:48.938309 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb because tablet deleting was already in progress. No further retry: Already present: State transition of tablet baf3e61bb2ab45d19d3ed0169f0a6cdb already in progress: creating tablet
I20260812 19:26:48.957767 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 77445461e7f24c1e80bedb96b2af5daf (DEFAULT_TABLE table=default.Table_3450db0f15ec43dfb63b86b025614242 [id=23c4b17280f540ddacaf2fe8b08715c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.965046 8627 raft_consensus.cc:348] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.965713 8627 raft_consensus.cc:374] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.965963 8627 raft_consensus.cc:729] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.966579 8627 consensus_queue.cc:260] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:48.968111 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_23fba63fdbc84d25b260bc3ba2434a92" } new_table_name: "default.Table_5e620180d68c4c70be82888448511fa3" modify_external_catalogs: true
I20260812 19:26:48.968645 8627 ts_tablet_manager.cc:1428] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 19:26:48.969620 8627 tablet_bootstrap.cc:492] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:48.967630 8327 tablet_service.cc:1467] Processing CreateTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd (DEFAULT_TABLE table=default.Table_ef547861981d429baacbb9286c8fc629 [id=27b6a83f08704d199cbb25ab55bc634b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:48.975834 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 946ac8237fb5475cab84ce69180e13b0 (table default.Table_93219d4aa801471ab3650eb30f289b21 [id=1c3e047dba584132ba65b5c2db357a33]) successfully deleted
I20260812 19:26:48.966609 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77445461e7f24c1e80bedb96b2af5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.978796 8636 tablet_bootstrap.cc:492] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:48.979166 8636 ts_tablet_manager.cc:1397] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.094s user 0.004s sys 0.014s
I20260812 19:26:48.980597 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb55b45c8db944b18d1fcc0ea92dbebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:48.981405 8636 raft_consensus.cc:348] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.982081 8636 raft_consensus.cc:374] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:48.982317 8636 raft_consensus.cc:729] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:48.984516 8636 consensus_queue.cc:260] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.998137 8731 raft_consensus.cc:482] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:48.998567 8731 raft_consensus.cc:504] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:49.000286 8636 ts_tablet_manager.cc:1428] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.021s user 0.006s sys 0.002s
I20260812 19:26:49.000624 8731 leader_election.cc:288] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:49.001130 8636 tablet_bootstrap.cc:492] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:49.001296 8648 leader_election.cc:288] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:49.003057 8731 raft_consensus.cc:482] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:49.003486 8731 raft_consensus.cc:504] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:48.835880 8625 ts_tablet_manager.cc:1918] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:49.005239 8625 log.cc:1196] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/b24558d110b044a58a0d31b9b9a16362
I20260812 19:26:49.005303 8731 leader_election.cc:288] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:49.006506 8625 ts_tablet_manager.cc:1939] T b24558d110b044a58a0d31b9b9a16362 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:49.012241 8636 tablet_bootstrap.cc:654] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:49.021294 8691 raft_consensus.cc:482] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:49.021914 8691 raft_consensus.cc:504] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.023569 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_cd0f58a9167840b08cbbd973898ab3e1"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:49.025309 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cd0f58a9167840b08cbbd973898ab3e1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:49.024192 8691 leader_election.cc:288] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:49.028824 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68583d63475a495ca97f3221825622e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.035995 8108 leader_election.cc:302] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:49.055344 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:49.058614 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:49.061641 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a43b5f9446b4ed4a0349af7d8c16f8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:49.061661 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1bd8f6905c24ae19c3370246028f7fd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:49.062638 8691 consensus_queue.cc:1035] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:49.067677 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77445461e7f24c1e80bedb96b2af5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.068480 8627 tablet_bootstrap.cc:654] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:49.072829 8107 leader_election.cc:341] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.074476 8623 raft_consensus.cc:348] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.075429 8623 raft_consensus.cc:374] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:49.075671 8623 raft_consensus.cc:729] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:49.079023 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 34) took 1437 ms. Trace:
W20260812 19:26:49.080804 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 45074.4us
I20260812 19:26:49.083056 8648 raft_consensus.cc:2781] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:49.082907 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2a43b5f9446b4ed4a0349af7d8c16f8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:49.083359 8648 raft_consensus.cc:482] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:49.083680 8648 raft_consensus.cc:3037] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.090195 8627 tablet_bootstrap.cc:492] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:49.090574 8627 ts_tablet_manager.cc:1397] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.121s user 0.009s sys 0.000s
I20260812 19:26:49.090121 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_b42edede4b02496c9387f0802f4379f6"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:49.091889 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b42edede4b02496c9387f0802f4379f6 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:49.092674 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_736993619204407d83bd0619aee8a645"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:49.094422 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_736993619204407d83bd0619aee8a645 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:49.097976 8147 tablet_service.cc:1467] Processing CreateTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd (DEFAULT_TABLE table=default.Table_ef547861981d429baacbb9286c8fc629 [id=27b6a83f08704d199cbb25ab55bc634b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.097788 8627 raft_consensus.cc:348] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:49.098842 8627 raft_consensus.cc:374] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:49.099172 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb55b45c8db944b18d1fcc0ea92dbebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.099143 8627 raft_consensus.cc:729] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:49.099851 8627 consensus_queue.cc:260] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:49.101019 8443 leader_election.cc:302] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:49.102173 8731 raft_consensus.cc:2726] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:49.103204 8443 leader_election.cc:341] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: ef215230eb7e456b8c3ec35f13c06920
I20260812 19:26:48.942493 7960 catalog_manager.cc:5495] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:49.104213 8278 consensus_peers.cc:487] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.104789 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
W20260812 19:26:49.104924 8278 leader_election.cc:341] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.106786 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1bd8f6905c24ae19c3370246028f7fd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:49.107326 8356 raft_consensus.cc:3037] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.113720 8356 raft_consensus.cc:2454] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:49.117429 8626 ts_tablet_manager.cc:1918] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:49.118898 8627 ts_tablet_manager.cc:1428] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260812 19:26:49.119832 8627 tablet_bootstrap.cc:492] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:49.127933 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_77f5368431cf473daab21a349c850ca8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:49.129875 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_77f5368431cf473daab21a349c850ca8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:49.130771 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef215230eb7e456b8c3ec35f13c06920" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:49.131436 8182 raft_consensus.cc:2454] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:26:49.079411 8625 rpcz_store.cc:276] 0812 19:26:47.641724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:47.644370 (+ 2646us) service_pool.cc:227] Handling call
0812 19:26:48.419948 (+775578us) ts_tablet_manager.cc:1145] Deleting tablet b24558d110b044a58a0d31b9b9a16362
0812 19:26:48.419995 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:48.755571 (+335576us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:48.835488 (+ 79917us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:49.078925 (+243437us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":718719}
I20260812 19:26:49.133101 8625 tablet_replica.cc:330] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:49.134109 8625 raft_consensus.cc:2229] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:49.134253 8107 consensus_peers.cc:487] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33bcf8d54395461d9eb07965966153a1. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.134614 8625 raft_consensus.cc:2258] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:49.135497 8281 leader_election.cc:341] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.135644 8108 leader_election.cc:302] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:49.135944 8281 leader_election.cc:302] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:26:49.136881 8108 consensus_peers.cc:487] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33bcf8d54395461d9eb07965966153a1. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.136982 8753 raft_consensus.cc:2726] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:49.138310 8701 raft_consensus.cc:2781] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:49.138826 8701 raft_consensus.cc:686] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:49.097043 8623 consensus_queue.cc:260] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.139703 8701 consensus_queue.cc:237] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.141341 8623 ts_tablet_manager.cc:1428] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.346s user 0.006s sys 0.005s
I20260812 19:26:49.142266 8623 tablet_bootstrap.cc:492] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:49.146968 8625 ts_tablet_manager.cc:1905] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:49.106233 7960 catalog_manager.cc:5495] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:49.148813 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_26456d69980b4cbe8f39b8d7c9592701 [id=207aa714585c4a20a2ccb8fc894c04b4]). Expected version 1 got 0
I20260812 19:26:49.149614 8627 tablet_bootstrap.cc:654] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:49.150297 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1bd8f6905c24ae19c3370246028f7fd consensus state has no leader
I20260812 19:26:49.156692 8329 tablet_service.cc:1467] Processing CreateTablet for tablet b00a037a2567470497e1a751754df345 (DEFAULT_TABLE table=default.Table_659a9b2148dd4d55a121a8c2e0a5881a [id=60482d1ceb2c46ecb33a2f2b2d87e067]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.136487 8516 raft_consensus.cc:3037] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.157825 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b00a037a2567470497e1a751754df345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.137709 8446 leader_election.cc:302] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:49.165128 8731 raft_consensus.cc:2781] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:49.165496 8731 raft_consensus.cc:482] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:49.165947 8731 raft_consensus.cc:3037] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.167163 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet b24558d110b044a58a0d31b9b9a16362 (table default.Table_f8ddd255d758494fb731ca72c5992730 [id=6335f2c2d0ec40baab46d0b760c3b3b1]) successfully deleted
I20260812 19:26:49.171648 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_529a8f7f567641e381f494dc373c2182" } new_table_name: "default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed" modify_external_catalogs: true
I20260812 19:26:49.173722 8731 raft_consensus.cc:504] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:49.178711 8731 leader_election.cc:288] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:49.176748 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef215230eb7e456b8c3ec35f13c06920" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:49.184808 7956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3450db0f15ec43dfb63b86b025614242" } modify_external_catalogs: true
I20260812 19:26:49.185370 7956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3450db0f15ec43dfb63b86b025614242" } modify_external_catalogs: true
W20260812 19:26:49.179452 8443 leader_election.cc:341] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: ef215230eb7e456b8c3ec35f13c06920
I20260812 19:26:49.179797 8626 log.cc:1196] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/b24558d110b044a58a0d31b9b9a16362
I20260812 19:26:49.188503 8626 ts_tablet_manager.cc:1939] T b24558d110b044a58a0d31b9b9a16362 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:49.157615 8636 tablet_bootstrap.cc:492] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:49.191424 8636 ts_tablet_manager.cc:1397] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.190s user 0.018s sys 0.012s
I20260812 19:26:49.193737 8636 raft_consensus.cc:348] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.194461 8636 raft_consensus.cc:374] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:49.194698 8636 raft_consensus.cc:729] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:49.195554 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_950444052d854c34a6f03fe473988bff" } modify_external_catalogs: true
I20260812 19:26:49.195719 8648 raft_consensus.cc:504] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.196162 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_950444052d854c34a6f03fe473988bff" } modify_external_catalogs: true
W20260812 19:26:49.197451 8446 leader_election.cc:341] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.197873 8446 leader_election.cc:302] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:49.198364 8648 leader_election.cc:288] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:49.199144 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538d05c5883d4575b8eb5d42dfb3c246" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:49.199352 8158 tablet_service.cc:1467] Processing CreateTablet for tablet b00a037a2567470497e1a751754df345 (DEFAULT_TABLE table=default.Table_659a9b2148dd4d55a121a8c2e0a5881a [id=60482d1ceb2c46ecb33a2f2b2d87e067]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.199771 8356 raft_consensus.cc:3037] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.201257 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "538d05c5883d4575b8eb5d42dfb3c246" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:26:49.202919 8107 leader_election.cc:341] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.210281 8731 raft_consensus.cc:2726] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:26:49.218438 8623 tablet_bootstrap.cc:654] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:49.225418 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 (DEFAULT_TABLE table=default.Table_4fce364e6d9545ae96b3b503b1fc5b71 [id=25842a7a7f6f400a867cc04b5ee0f2fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.225551 8356 raft_consensus.cc:2454] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:49.227584 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fe5774f8dc46308954e9be54bd92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.227972 8108 leader_election.cc:302] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:49.229892 8648 raft_consensus.cc:2781] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:49.230644 8648 raft_consensus.cc:686] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:49.236864 8626 tablet_replica.cc:330] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:49.238684 8626 raft_consensus.cc:2229] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.239555 8626 raft_consensus.cc:2258] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.240561 8636 consensus_queue.cc:260] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.246352 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 68583d63475a495ca97f3221825622e2 (DEFAULT_TABLE table=default.Table_9c9d2b97c285484a900a37c33effcecb [id=0479fcb4d0ff44bd98ce28beddd898be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.248680 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68583d63475a495ca97f3221825622e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.253358 8636 ts_tablet_manager.cc:1428] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.062s user 0.005s sys 0.001s
I20260812 19:26:49.254503 8636 tablet_bootstrap.cc:492] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:49.255378 8627 tablet_bootstrap.cc:492] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:49.255892 8627 ts_tablet_manager.cc:1397] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.136s user 0.006s sys 0.002s
I20260812 19:26:49.232870 8648 consensus_queue.cc:237] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.265066 8490 tablet_service.cc:1514] Processing DeleteTablet for tablet 719b756d5db14d61948280d42a42234a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:49.266350 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 77445461e7f24c1e80bedb96b2af5daf (DEFAULT_TABLE table=default.Table_3450db0f15ec43dfb63b86b025614242 [id=23c4b17280f540ddacaf2fe8b08715c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.269181 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77445461e7f24c1e80bedb96b2af5daf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.276520 8627 raft_consensus.cc:348] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:49.277455 8627 raft_consensus.cc:374] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:49.277776 8627 raft_consensus.cc:729] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:49.278614 8627 consensus_queue.cc:260] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:49.278790 8490 tablet_service.cc:1467] Processing CreateTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd (DEFAULT_TABLE table=default.Table_ef547861981d429baacbb9286c8fc629 [id=27b6a83f08704d199cbb25ab55bc634b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.281035 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cb55b45c8db944b18d1fcc0ea92dbebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.263639 8626 ts_tablet_manager.cc:1905] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:49.299093 8492 tablet_service.cc:1467] Processing CreateTablet for tablet b00a037a2567470497e1a751754df345 (DEFAULT_TABLE table=default.Table_659a9b2148dd4d55a121a8c2e0a5881a [id=60482d1ceb2c46ecb33a2f2b2d87e067]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.301411 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b00a037a2567470497e1a751754df345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.305972 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b00a037a2567470497e1a751754df345. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.314133 8636 tablet_bootstrap.cc:654] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:49.314380 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 017b6bfef5f44da0866917e04e2db072 (DEFAULT_TABLE table=default.Table_61a5cdb267bc48488c3252251f1e139a [id=88cdc52eec7c44d992f08f4c170a5489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.316654 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 017b6bfef5f44da0866917e04e2db072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.325852 8755 raft_consensus.cc:482] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:49.326814 8755 raft_consensus.cc:504] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.333395 8755 leader_election.cc:288] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:49.335901 8627 ts_tablet_manager.cc:1428] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.080s user 0.010s sys 0.000s
I20260812 19:26:49.345140 8766 raft_consensus.cc:482] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:49.346577 8627 tablet_bootstrap.cc:492] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:49.352634 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b961a688b260424499bef8e6bf62734f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:49.346158 8766 raft_consensus.cc:504] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:49.365453 8281 leader_election.cc:341] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.369280 8766 leader_election.cc:288] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:49.383044 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 017b6bfef5f44da0866917e04e2db072 (DEFAULT_TABLE table=default.Table_61a5cdb267bc48488c3252251f1e139a [id=88cdc52eec7c44d992f08f4c170a5489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.398337 8517 raft_consensus.cc:3037] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.404942 8627 tablet_bootstrap.cc:654] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:49.409107 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 (DEFAULT_TABLE table=default.Table_4fce364e6d9545ae96b3b503b1fc5b71 [id=25842a7a7f6f400a867cc04b5ee0f2fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.411300 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fe5774f8dc46308954e9be54bd92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.412909 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 017b6bfef5f44da0866917e04e2db072. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:49.409593 8770 log.cc:924] Time spent T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.103s user 0.003s sys 0.004s
W20260812 19:26:49.417680 8443 leader_election.cc:341] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 719b756d5db14d61948280d42a42234a
W20260812 19:26:49.422974 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5bfebac9602f494eb19772589992f888 consensus state has no leader
I20260812 19:26:49.424841 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b961a688b260424499bef8e6bf62734f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:49.425660 8446 leader_election.cc:341] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 719b756d5db14d61948280d42a42234a
I20260812 19:26:49.426489 8446 leader_election.cc:302] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:49.429525 8766 raft_consensus.cc:2726] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:49.435788 8623 tablet_bootstrap.cc:492] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:49.436357 8623 ts_tablet_manager.cc:1397] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.294s user 0.018s sys 0.020s
I20260812 19:26:49.443830 8623 raft_consensus.cc:348] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.444816 8623 raft_consensus.cc:374] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:49.445147 8623 raft_consensus.cc:729] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
W20260812 19:26:49.440809 7948 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 47221.6us
W20260812 19:26:49.468827 8278 leader_election.cc:341] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.469650 8278 leader_election.cc:302] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:49.472206 8755 raft_consensus.cc:2726] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:49.473011 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 1950030ab501429a91971f80f761a172 (DEFAULT_TABLE table=default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.474988 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1950030ab501429a91971f80f761a172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.474934 8755 consensus_queue.cc:1035] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:26:49.479481 8278 consensus_peers.cc:487] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:49.488703 8623 consensus_queue.cc:260] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.499729 8328 tablet_service.cc:1467] Processing CreateTablet for tablet 1950030ab501429a91971f80f761a172 (DEFAULT_TABLE table=default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.502434 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1950030ab501429a91971f80f761a172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.511627 8623 ts_tablet_manager.cc:1428] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.075s user 0.008s sys 0.000s
I20260812 19:26:49.537106 8332 tablet_service.cc:1467] Processing CreateTablet for tablet 5f73e97db5954612ab9dfa21bc435efd (DEFAULT_TABLE table=default.Table_972f4f7d001a49da90d12d0b96a2548e [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.539037 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f73e97db5954612ab9dfa21bc435efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.575935 8766 raft_consensus.cc:482] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:49.576764 8766 raft_consensus.cc:504] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.580811 8766 leader_election.cc:288] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:49.584939 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5bfebac9602f494eb19772589992f888 consensus state has no leader
I20260812 19:26:49.592245 8626 ts_tablet_manager.cc:1918] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:49.592864 8626 log.cc:1196] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/ef215230eb7e456b8c3ec35f13c06920
I20260812 19:26:49.524435 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet b24558d110b044a58a0d31b9b9a16362 (table default.Table_f8ddd255d758494fb731ca72c5992730 [id=6335f2c2d0ec40baab46d0b760c3b3b1]) successfully deleted
I20260812 19:26:49.593935 8626 ts_tablet_manager.cc:1939] T ef215230eb7e456b8c3ec35f13c06920 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:49.596789 7956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 77445461e7f24c1e80bedb96b2af5daf
W20260812 19:26:49.601411 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 77010.9us
I20260812 19:26:49.623592 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 017b6bfef5f44da0866917e04e2db072 (DEFAULT_TABLE table=default.Table_61a5cdb267bc48488c3252251f1e139a [id=88cdc52eec7c44d992f08f4c170a5489]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.623853 8494 tablet_service.cc:1467] Processing CreateTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 (DEFAULT_TABLE table=default.Table_4fce364e6d9545ae96b3b503b1fc5b71 [id=25842a7a7f6f400a867cc04b5ee0f2fd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.624984 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 017b6bfef5f44da0866917e04e2db072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.626407 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69fe5774f8dc46308954e9be54bd92b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.513995 8773 tablet.cc:1722] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 3
I20260812 19:26:49.652477 7957 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cd0f58a9167840b08cbbd973898ab3e1" } new_table_name: "default.Table_9f6c648486734773bac487f03209f60b" modify_external_catalogs: true
I20260812 19:26:49.658252 8623 tablet_bootstrap.cc:492] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:49.658207 7956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d1b1c2c2ebf944dd90282c4764c63acc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:49.669226 7956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d1b1c2c2ebf944dd90282c4764c63acc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:49.645088 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 5f73e97db5954612ab9dfa21bc435efd (DEFAULT_TABLE table=default.Table_972f4f7d001a49da90d12d0b96a2548e [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:49.675491 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 57529.4us
I20260812 19:26:49.684684 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_acc40462fc7f4aa18145381334c3f325"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:49.684212 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3be82128696447e85758e8595b7e9e6" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:49.687077 8179 raft_consensus.cc:2454] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
W20260812 19:26:49.689110 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_acc40462fc7f4aa18145381334c3f325 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:49.689944 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_7ab1c8c2ce1943169508c49fb732ba91"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:49.686430 8701 raft_consensus.cc:482] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:26:49.693958 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7ab1c8c2ce1943169508c49fb732ba91 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:49.696409 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 77445461e7f24c1e80bedb96b2af5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:49.699954 8701 raft_consensus.cc:504] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.701849 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 5f73e97db5954612ab9dfa21bc435efd (DEFAULT_TABLE table=default.Table_972f4f7d001a49da90d12d0b96a2548e [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.706678 8625 ts_tablet_manager.cc:1918] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:49.715036 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decf138a91394c939f686ff127ca7922" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:49.716078 8354 raft_consensus.cc:2454] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:49.725450 8625 log.cc:1196] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/ef215230eb7e456b8c3ec35f13c06920
I20260812 19:26:49.726933 8108 leader_election.cc:302] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:49.728209 8648 raft_consensus.cc:2781] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:49.729017 8648 raft_consensus.cc:482] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:49.728999 8755 raft_consensus.cc:482] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:49.729713 8648 raft_consensus.cc:3037] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.729907 8755 raft_consensus.cc:504] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:26:49.732513 8443 leader_election.cc:341] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: d3be82128696447e85758e8595b7e9e6
I20260812 19:26:49.737311 8626 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 37) took 1177 ms. Trace:
I20260812 19:26:49.738837 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet 77445461e7f24c1e80bedb96b2af5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:49.740660 8446 leader_election.cc:302] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:49.738092 8626 rpcz_store.cc:276] 0812 19:26:48.559939 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:48.560177 (+ 238us) service_pool.cc:227] Handling call
0812 19:26:49.236466 (+676289us) ts_tablet_manager.cc:1145] Deleting tablet ef215230eb7e456b8c3ec35f13c06920
0812 19:26:49.236589 (+ 123us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:49.392659 (+156070us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:49.591835 (+199176us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:49.737203 (+145368us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":675079}
I20260812 19:26:49.743386 8766 raft_consensus.cc:2781] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:49.745563 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f73e97db5954612ab9dfa21bc435efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.752342 8766 raft_consensus.cc:482] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:49.753049 8766 raft_consensus.cc:3037] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.760883 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet ef215230eb7e456b8c3ec35f13c06920 (table default.Table_2083a9f074f24a1dbd1932caf189ad9b [id=a4a65136c70d4d33a3300ba7903c3ec2]) successfully deleted
I20260812 19:26:49.763811 8492 tablet_service.cc:1467] Processing CreateTablet for tablet 1950030ab501429a91971f80f761a172 (DEFAULT_TABLE table=default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:49.766901 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1950030ab501429a91971f80f761a172. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.772912 8626 tablet_replica.cc:330] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:49.773913 8626 raft_consensus.cc:2229] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:49.774456 8626 raft_consensus.cc:2258] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.811918 8701 leader_election.cc:288] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:49.813223 8625 ts_tablet_manager.cc:1939] T ef215230eb7e456b8c3ec35f13c06920 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:49.818132 8623 tablet_bootstrap.cc:654] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:49.762413 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet b961a688b260424499bef8e6bf62734f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b961a688b260424499bef8e6bf62734f already in progress: creating tablet
W20260812 19:26:49.835536 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 73196us
I20260812 19:26:49.806021 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f73e97db5954612ab9dfa21bc435efd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:49.838166 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 77445461e7f24c1e80bedb96b2af5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:49.839010 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 36) took 2193 ms. Trace:
I20260812 19:26:49.844729 8755 leader_election.cc:288] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:49.851276 8626 ts_tablet_manager.cc:1905] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:49.839869 8625 rpcz_store.cc:276] 0812 19:26:47.645163 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:47.645303 (+ 140us) service_pool.cc:227] Handling call
0812 19:26:49.132853 (+1487550us) ts_tablet_manager.cc:1145] Deleting tablet ef215230eb7e456b8c3ec35f13c06920
0812 19:26:49.132947 (+ 94us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:49.413017 (+280070us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:49.706338 (+293321us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:49.838943 (+132605us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1431378}
I20260812 19:26:49.854679 7956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e010f3079ed44b45a4fc2e16e494a9aa" } new_table_name: "default.Table_94076c31f10744b49ed2803dca34a8de" modify_external_catalogs: true
I20260812 19:26:49.855204 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet ef215230eb7e456b8c3ec35f13c06920 (table default.Table_2083a9f074f24a1dbd1932caf189ad9b [id=a4a65136c70d4d33a3300ba7903c3ec2]) successfully deleted
W20260812 19:26:49.860702 8773 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.222s user 0.000s sys 0.006s
I20260812 19:26:49.866586 8779 tablet.cc:1722] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:49.882468 8783 raft_consensus.cc:482] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:49.883270 8783 raft_consensus.cc:504] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:49.889004 8625 tablet_replica.cc:330] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:49.889954 8625 raft_consensus.cc:2229] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:49.890990 8625 pending_rounds.cc:62] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:26:49.896689 8648 raft_consensus.cc:504] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:49.902153 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:49.904163 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:49.905326 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decf138a91394c939f686ff127ca7922" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:49.906420 8354 raft_consensus.cc:3037] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:49.907004 7953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ef547861981d429baacbb9286c8fc629" } modify_external_catalogs: true
I20260812 19:26:49.907948 7953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ef547861981d429baacbb9286c8fc629" } modify_external_catalogs: true
W20260812 19:26:49.910387 8281 leader_election.cc:341] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:49.911633 8281 leader_election.cc:341] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.912503 8648 leader_election.cc:288] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:49.891263 8625 pending_rounds.cc:68] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761261584789504 op_type: NO_OP noop_request { }
I20260812 19:26:49.913875 8625 raft_consensus.cc:2866] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:49.914247 8625 raft_consensus.cc:2258] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:49.888118 8783 leader_election.cc:288] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:49.916706 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8ec5028fb16b41b6b3b4d0d7beed88ea"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:49.920382 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8ec5028fb16b41b6b3b4d0d7beed88ea in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:49.924790 7956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet dab1e77a362d483788ac38318df3b58a consensus state has no leader
W20260812 19:26:49.933627 7957 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 756557a37a924bcf9d7c0743beed6a9d has no consensus state
W20260812 19:26:49.936689 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 946ac8237fb5475cab84ce69180e13b0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 946ac8237fb5475cab84ce69180e13b0 already in progress: creating tablet
I20260812 19:26:49.937171 8625 ts_tablet_manager.cc:1905] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:49.956641 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decf138a91394c939f686ff127ca7922" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:49.959951 8107 leader_election.cc:341] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.978091 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:49.983973 8278 leader_election.cc:341] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.984781 8278 leader_election.cc:302] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:49.986562 8623 tablet_bootstrap.cc:492] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:49.982487 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decf138a91394c939f686ff127ca7922" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:49.987092 8623 ts_tablet_manager.cc:1397] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.369s user 0.009s sys 0.012s
I20260812 19:26:49.963240 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:49.991881 8107 leader_election.cc:341] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:49.994872 8626 ts_tablet_manager.cc:1918] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:49.995376 8626 log.cc:1196] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/719b756d5db14d61948280d42a42234a
I20260812 19:26:49.996196 8626 ts_tablet_manager.cc:1939] T 719b756d5db14d61948280d42a42234a P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
W20260812 19:26:50.007496 8330 consensus_meta.cc:287] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Time spent flushing consensus metadata: real 0.514s user 0.006s sys 0.003s
I20260812 19:26:50.026297 8623 raft_consensus.cc:348] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.027199 8623 raft_consensus.cc:374] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:50.027504 8623 raft_consensus.cc:729] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:50.028359 8623 consensus_queue.cc:260] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.031586 8623 ts_tablet_manager.cc:1428] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.044s user 0.007s sys 0.002s
I20260812 19:26:50.038149 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:50.043846 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_26456d69980b4cbe8f39b8d7c9592701 [id=207aa714585c4a20a2ccb8fc894c04b4]). Expected version 1 got 0
I20260812 19:26:50.049077 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_5e620180d68c4c70be82888448511fa3 [id=3c0970afdc834aff921d14ba6ab03647]). Expected version 1 got 0
I20260812 19:26:50.057518 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet e1198960d8ea400387d189762d9549b6
W20260812 19:26:50.062970 7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 22) took 1053 ms (client timeout 1000 ms). Trace:
W20260812 19:26:50.044798 8156 consensus_meta.cc:287] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.570s user 0.010s sys 0.002s
I20260812 19:26:50.046193 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 756557a37a924bcf9d7c0743beed6a9d (DEFAULT_TABLE table=default.Table_9f6c648486734773bac487f03209f60b [id=c04a06245afc4bc39447bcb6ca5940af]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:50.063589 7962 rpcz_store.cc:269] 0812 19:26:49.009785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:49.009921 (+ 136us) service_pool.cc:227] Handling call
0812 19:26:50.062844 (+1052923us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":1}
I20260812 19:26:50.073953 8625 ts_tablet_manager.cc:1918] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:50.074679 8625 log.cc:1196] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/33bcf8d54395461d9eb07965966153a1
I20260812 19:26:50.081743 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet e1198960d8ea400387d189762d9549b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:50.084038 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 (DEFAULT_TABLE table=default.Table_736993619204407d83bd0619aee8a645 [id=589f397fce314ea1ad0c0e42e4943267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.041196 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 11eb974d35ba42418292e5a9fa82e331 (DEFAULT_TABLE table=default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.101140 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.101251 7960 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_63698336eb614df88eca5031884199fd [id=3e92ad5d601b482aaabc37ffd7e7a9e7] alter complete (version 3)
I20260812 19:26:50.105392 8623 tablet_bootstrap.cc:492] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:26:50.111093 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 22) took 1365 ms (client timeout 1000 ms). Trace:
W20260812 19:26:50.111685 8636 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.705s user 0.030s sys 0.038s
W20260812 19:26:50.112675 8636 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.706s user 0.030s sys 0.038s
I20260812 19:26:50.113487 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756557a37a924bcf9d7c0743beed6a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.120729 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11eb974d35ba42418292e5a9fa82e331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.123476 8490 tablet_service.cc:1467] Processing CreateTablet for tablet 11eb974d35ba42418292e5a9fa82e331 (DEFAULT_TABLE table=default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.127375 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 756557a37a924bcf9d7c0743beed6a9d (DEFAULT_TABLE table=default.Table_9f6c648486734773bac487f03209f60b [id=c04a06245afc4bc39447bcb6ca5940af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.128818 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 (DEFAULT_TABLE table=default.Table_736993619204407d83bd0619aee8a645 [id=589f397fce314ea1ad0c0e42e4943267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.143235 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756557a37a924bcf9d7c0743beed6a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.143898 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet e1198960d8ea400387d189762d9549b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:50.145032 8626 tablet_replica.cc:330] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:50.145864 8626 raft_consensus.cc:2229] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.146495 8626 raft_consensus.cc:2258] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.170039 8627 tablet_bootstrap.cc:492] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:50.170944 8627 ts_tablet_manager.cc:1397] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.824s user 0.018s sys 0.005s
W20260812 19:26:50.160924 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 177022us
I20260812 19:26:50.183830 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_e72885fe051d48ee9af557340be9798b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:50.187378 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e72885fe051d48ee9af557340be9798b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:50.190639 7955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_26456d69980b4cbe8f39b8d7c9592701" } new_table_name: "default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6" modify_external_catalogs: true
I20260812 19:26:50.193023 8784 raft_consensus.cc:2726] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:50.194236 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_c5c2449187eb429faa8378da84b0adad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:50.195660 8623 tablet_bootstrap.cc:654] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:50.197248 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 11eb974d35ba42418292e5a9fa82e331 (DEFAULT_TABLE table=default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.199222 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11eb974d35ba42418292e5a9fa82e331. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:50.198956 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c5c2449187eb429faa8378da84b0adad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:50.169202 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 11eb974d35ba42418292e5a9fa82e331. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.201109 8625 ts_tablet_manager.cc:1939] T 33bcf8d54395461d9eb07965966153a1 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:50.203815 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 37) took 2556 ms. Trace:
I20260812 19:26:50.165709 8626 ts_tablet_manager.cc:1905] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:50.205842 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.226641 8636 tablet_bootstrap.cc:492] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:50.227197 8636 ts_tablet_manager.cc:1397] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.973s user 0.033s sys 0.051s
I20260812 19:26:50.165313 8766 raft_consensus.cc:504] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.243757 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3be82128696447e85758e8595b7e9e6" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:50.244724 8182 raft_consensus.cc:3037] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:50.245163 7953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet cb55b45c8db944b18d1fcc0ea92dbebd
W20260812 19:26:50.235781 8107 consensus_peers.cc:487] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.204187 8625 rpcz_store.cc:276] 0812 19:26:47.647010 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:47.647156 (+ 146us) service_pool.cc:227] Handling call
0812 19:26:49.888792 (+2241636us) ts_tablet_manager.cc:1145] Deleting tablet 33bcf8d54395461d9eb07965966153a1
0812 19:26:49.888862 (+ 70us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:50.044026 (+155164us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:50.073647 (+ 29621us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:50.203736 (+130089us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2187137}
I20260812 19:26:50.254196 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 33bcf8d54395461d9eb07965966153a1 (table default.Table_2d1f3cf019494f3ba9e1aa5492599638 [id=86f25ffe25e341069e55a288d5c0d998]) successfully deleted
I20260812 19:26:50.255604 8625 tablet_replica.cc:330] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:50.259485 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_7e451ef9f71049ddb6e99c4b2fe2c86b" } new_table_name: "default.Table_45bab0149eb241b59b363bf986003fee" modify_external_catalogs: true
W20260812 19:26:50.111850 7960 rpcz_store.cc:269] 0812 19:26:48.745466 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:48.748414 (+ 2948us) service_pool.cc:227] Handling call
0812 19:26:50.110966 (+1362552us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:49.167870 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:49.168221 (+ 351us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:49.168281 (+ 60us) write_op.cc:435] Acquired schema lock
0812 19:26:49.168294 (+ 13us) tablet.cc:660] Decoding operations
0812 19:26:49.168608 (+ 314us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:49.168650 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:49.168672 (+ 22us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:49.168936 (+ 264us) tablet.cc:699] Row locks acquired
0812 19:26:49.168950 (+ 14us) write_op.cc:260] PREPARE: finished
0812 19:26:49.169059 (+ 109us) write_op.cc:270] Start()
0812 19:26:49.169137 (+ 78us) write_op.cc:276] Timestamp: P: 1786562809168987 usec, L: 0
0812 19:26:49.169152 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:26:49.169629 (+ 477us) log.cc:842] Serialized 912 byte log entry
0812 19:26:49.338518 (+168889us) op_driver.cc:444] REPLICATION: finished
0812 19:26:49.339646 (+ 1128us) write_op.cc:301] APPLY: starting
0812 19:26:49.339754 (+ 108us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:49.358034 (+ 18280us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:49.358297 (+ 263us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:49.398454 (+ 40157us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:49.398770 (+ 316us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:49.398903 (+ 133us) write_op.cc:312] APPLY: finished
0812 19:26:49.399319 (+ 416us) log.cc:842] Serialized 28 byte log entry
0812 19:26:49.399622 (+ 303us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:49.399732 (+ 110us) write_op.cc:454] Released schema lock
0812 19:26:49.399774 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:49.400052 (+ 278us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:49.400106 (+ 54us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 19:26:50.077170 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:50.077614 (+ 444us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:50.077642 (+ 28us) write_op.cc:435] Acquired schema lock
0812 19:26:50.077658 (+ 16us) tablet.cc:660] Decoding operations
0812 19:26:50.078055 (+ 397us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:50.078100 (+ 45us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:50.078134 (+ 34us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:50.078309 (+ 175us) tablet.cc:699] Row locks acquired
0812 19:26:50.078322 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:50.078453 (+ 131us) write_op.cc:270] Start()
0812 19:26:50.078547 (+ 94us) write_op.cc:276] Timestamp: P: 1786562810078238 usec, L: 0
0812 19:26:50.078563 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:26:50.079206 (+ 643us) log.cc:842] Serialized 355 byte log entry
0812 19:26:50.098328 (+ 19122us) op_driver.cc:444] REPLICATION: finished
0812 19:26:50.098906 (+ 578us) write_op.cc:301] APPLY: starting
0812 19:26:50.098982 (+ 76us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:50.099178 (+ 196us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:50.099319 (+ 141us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:50.099577 (+ 258us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:50.099820 (+ 243us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:50.099912 (+ 92us) write_op.cc:312] APPLY: finished
0812 19:26:50.100198 (+ 286us) log.cc:842] Serialized 22 byte log entry
0812 19:26:50.100436 (+ 238us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:50.100542 (+ 106us) write_op.cc:454] Released schema lock
0812 19:26:50.100594 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:50.100927 (+ 333us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:50.100978 (+ 51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":890,"apply.run_cpu_time_us":3159,"apply.run_wall_time_us":60816,"num_ops":2,"prepare.queue_time_us":15145,"prepare.run_cpu_time_us":1956,"prepare.run_wall_time_us":3102,"replication_time_us":169234}],["op",{"apply.queue_time_us":319,"apply.run_cpu_time_us":2357,"apply.run_wall_time_us":2357,"num_ops":1,"prepare.queue_time_us":2225,"prepare.run_cpu_time_us":2276,"prepare.run_wall_time_us":6967,"replication_time_us":19630}]]}
I20260812 19:26:50.263607 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_b35d6b9c90d24b21890d1b174ae92bdb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:50.270982 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b35d6b9c90d24b21890d1b174ae92bdb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:50.268035 8354 raft_consensus.cc:2454] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:50.267349 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 719b756d5db14d61948280d42a42234a (table default.Table_cfb4d04872c64c22a0d2f4519acab91d [id=93e1bfb55e0448178d16c0c7b724eeaa]) successfully deleted
W20260812 19:26:50.274557 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 77445461e7f24c1e80bedb96b2af5daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77445461e7f24c1e80bedb96b2af5daf already in progress: creating tablet
I20260812 19:26:50.275966 8625 raft_consensus.cc:2229] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.276576 8625 raft_consensus.cc:2258] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.280728 8627 raft_consensus.cc:348] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.281441 8627 raft_consensus.cc:374] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:50.281685 8627 raft_consensus.cc:729] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:50.282332 8627 consensus_queue.cc:260] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.288384 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 (DEFAULT_TABLE table=default.Table_736993619204407d83bd0619aee8a645 [id=589f397fce314ea1ad0c0e42e4943267]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.289716 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 756557a37a924bcf9d7c0743beed6a9d (DEFAULT_TABLE table=default.Table_9f6c648486734773bac487f03209f60b [id=c04a06245afc4bc39447bcb6ca5940af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.290621 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.291695 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet e1198960d8ea400387d189762d9549b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:50.299345 8786 tablet_replica.cc:330] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:50.301159 8786 raft_consensus.cc:2229] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:50.297524 8766 leader_election.cc:288] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:50.308861 8636 raft_consensus.cc:348] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.310628 8636 raft_consensus.cc:374] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:50.311302 8636 raft_consensus.cc:729] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:50.311517 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 946ac8237fb5475cab84ce69180e13b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:50.312564 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:50.313396 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:50.314147 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 756557a37a924bcf9d7c0743beed6a9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.323582 8786 raft_consensus.cc:2258] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.325665 8786 ts_tablet_manager.cc:1905] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:50.334684 8627 ts_tablet_manager.cc:1428] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.163s user 0.002s sys 0.006s
I20260812 19:26:50.336532 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:50.338320 8182 raft_consensus.cc:2454] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:26:50.339643 8446 leader_election.cc:302] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:26:50.340605 8766 raft_consensus.cc:2781] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:50.343112 8766 raft_consensus.cc:686] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:26:50.331480 8648 raft_consensus.cc:482] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:50.348567 8648 raft_consensus.cc:504] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.350762 8648 leader_election.cc:288] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:50.351433 8766 consensus_queue.cc:237] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.352545 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b961a688b260424499bef8e6bf62734f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:50.354308 8107 leader_election.cc:341] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:50.360800 8627 tablet_bootstrap.cc:492] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:50.366468 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b961a688b260424499bef8e6bf62734f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:50.367158 8354 raft_consensus.cc:2454] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:26:50.380789 8278 leader_election.cc:341] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:50.381621 8278 leader_election.cc:302] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:50.383103 8755 raft_consensus.cc:2726] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:50.384877 8108 leader_election.cc:302] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:50.377583 8773 tablet.cc:1717] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Skipping requested alter to schema version 3, tablet already version 3
I20260812 19:26:50.355387 8636 consensus_queue.cc:260] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:50.309576 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 77445461e7f24c1e80bedb96b2af5daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77445461e7f24c1e80bedb96b2af5daf already in progress: creating tablet
W20260812 19:26:50.398916 7946 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 89404.1us
I20260812 19:26:50.392714 8648 raft_consensus.cc:2781] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 19:26:50.398617 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 124079us
I20260812 19:26:50.406355 8627 tablet_bootstrap.cc:654] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:50.420387 8636 ts_tablet_manager.cc:1428] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.193s user 0.008s sys 0.001s
W20260812 19:26:50.421449 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 61fce7b5a9d84718a1ed252f9f5f91d9 consensus state has no leader
I20260812 19:26:50.421587 8636 tablet_bootstrap.cc:492] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:50.422946 8648 raft_consensus.cc:686] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
W20260812 19:26:50.443111 8443 leader_election.cc:341] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: d3be82128696447e85758e8595b7e9e6
I20260812 19:26:50.443660 8517 raft_consensus.cc:3037] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:50.453953 8798 tablet.cc:1722] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:50.483820 8627 tablet_bootstrap.cc:492] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:50.485569 8627 ts_tablet_manager.cc:1397] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.125s user 0.012s sys 0.004s
I20260812 19:26:50.494001 8786 ts_tablet_manager.cc:1918] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:50.494663 8786 log.cc:1196] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/e1198960d8ea400387d189762d9549b6
I20260812 19:26:50.494390 8701 consensus_queue.cc:1035] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:50.496150 8786 ts_tablet_manager.cc:1939] T e1198960d8ea400387d189762d9549b6 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:50.492540 8627 raft_consensus.cc:348] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.498654 8627 raft_consensus.cc:374] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:50.499291 8627 raft_consensus.cc:729] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:50.502668 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet e1198960d8ea400387d189762d9549b6 (table default.Table_950444052d854c34a6f03fe473988bff [id=786445bdb3f24639b52a307912df394d]) successfully deleted
I20260812 19:26:50.504063 8627 consensus_queue.cc:260] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.511157 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:50.526433 8627 ts_tablet_manager.cc:1428] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.039s user 0.008s sys 0.000s
W20260812 19:26:50.528650 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 946ac8237fb5475cab84ce69180e13b0 because the tablet was not found. No further retry: Not found: Tablet not found: 946ac8237fb5475cab84ce69180e13b0
W20260812 19:26:50.522239 7958 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 20) took 1056 ms (client timeout 1000 ms). Trace:
I20260812 19:26:50.545810 8786 tablet_replica.cc:330] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:26:50.542591 7958 rpcz_store.cc:269] 0812 19:26:49.471013 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:49.497393 (+ 26380us) service_pool.cc:227] Handling call
0812 19:26:50.521455 (+1024062us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":167094,"reported_tablets":9}
I20260812 19:26:50.556594 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_e9db95034a294403b47fcd2eeaaf4696"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:50.552057 8627 tablet_bootstrap.cc:492] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:50.565397 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_9f6c648486734773bac487f03209f60b" } modify_external_catalogs: true
I20260812 19:26:50.566398 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_9f6c648486734773bac487f03209f60b" } modify_external_catalogs: true
I20260812 19:26:50.569393 8786 raft_consensus.cc:2229] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:50.570428 8786 raft_consensus.cc:2258] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.574054 8786 ts_tablet_manager.cc:1905] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:50.446678 8800 raft_consensus.cc:482] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:50.587060 8800 raft_consensus.cc:504] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:50.589808 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e9db95034a294403b47fcd2eeaaf4696 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:50.591274 8626 ts_tablet_manager.cc:1918] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:50.591791 8626 log.cc:1196] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/e1198960d8ea400387d189762d9549b6
I20260812 19:26:50.592671 8626 ts_tablet_manager.cc:1939] T e1198960d8ea400387d189762d9549b6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:50.595675 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet e1198960d8ea400387d189762d9549b6 (table default.Table_950444052d854c34a6f03fe473988bff [id=786445bdb3f24639b52a307912df394d]) successfully deleted
I20260812 19:26:50.595999 8493 tablet_service.cc:1514] Processing DeleteTablet for tablet d3be82128696447e85758e8595b7e9e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:50.608827 8636 tablet_bootstrap.cc:654] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:50.609603 8648 consensus_queue.cc:237] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.618017 8627 tablet_bootstrap.cc:654] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:50.617998 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 61fce7b5a9d84718a1ed252f9f5f91d9 consensus state has no leader
I20260812 19:26:50.619463 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet d3be82128696447e85758e8595b7e9e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:50.623421 8800 leader_election.cc:288] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:50.626044 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 33bcf8d54395461d9eb07965966153a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:45 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:50.628111 8773 tablet.cc:1722] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:50.636790 8755 raft_consensus.cc:482] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:50.637565 8755 raft_consensus.cc:504] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.648208 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 818eae7a6645415e992c25565f7f3b5a (DEFAULT_TABLE table=default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.652578 8755 leader_election.cc:288] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:50.662746 8625 ts_tablet_manager.cc:1905] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:50.655882 7957 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6 [id=207aa714585c4a20a2ccb8fc894c04b4]). Expected version 2 got 1
I20260812 19:26:50.665230 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:50.672919 7957 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_5e620180d68c4c70be82888448511fa3 [id=3c0970afdc834aff921d14ba6ab03647]). Expected version 1 got 0
W20260812 19:26:50.674518 8281 leader_election.cc:341] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:50.686614 7957 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:50.687147 8627 tablet_bootstrap.cc:492] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:50.687686 8627 ts_tablet_manager.cc:1397] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.136s user 0.010s sys 0.012s
I20260812 19:26:50.689868 7957 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]). Expected version 1 got 0
I20260812 19:26:50.696008 8623 tablet_bootstrap.cc:492] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:50.696692 8623 ts_tablet_manager.cc:1397] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.592s user 0.013s sys 0.024s
I20260812 19:26:50.698937 8636 tablet_bootstrap.cc:492] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:50.699753 8636 ts_tablet_manager.cc:1397] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.278s user 0.014s sys 0.004s
I20260812 19:26:50.701947 8755 raft_consensus.cc:482] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:50.701581 8623 raft_consensus.cc:348] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.702812 8623 raft_consensus.cc:374] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:50.702680 8755 raft_consensus.cc:504] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.703388 8636 raft_consensus.cc:348] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.705535 8755 leader_election.cc:288] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:50.703269 8623 raft_consensus.cc:729] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:50.709685 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 756557a37a924bcf9d7c0743beed6a9d
I20260812 19:26:50.708316 7957 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb]). Expected version 2 got 0
I20260812 19:26:50.711242 8627 raft_consensus.cc:348] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.711916 8627 raft_consensus.cc:374] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:50.712013 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 756557a37a924bcf9d7c0743beed6a9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:50.712863 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet 756557a37a924bcf9d7c0743beed6a9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:50.715442 8626 tablet_replica.cc:330] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:50.716334 8626 raft_consensus.cc:2229] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:26:50.717815 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet cb55b45c8db944b18d1fcc0ea92dbebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb55b45c8db944b18d1fcc0ea92dbebd already in progress: creating tablet
I20260812 19:26:50.719542 8626 pending_rounds.cc:62] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Trying to abort 1 pending ops.
I20260812 19:26:50.719823 8626 pending_rounds.cc:68] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761271645585408 op_type: NO_OP noop_request { }
I20260812 19:26:50.704201 8636 raft_consensus.cc:374] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:26:50.731273 8107 consensus_peers.cc:487] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:50.720270 8626 raft_consensus.cc:2866] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:50.729823 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:50.744694 8626 raft_consensus.cc:2258] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:50.712157 8627 raft_consensus.cc:729] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:26:50.746407 8278 leader_election.cc:341] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:50.736732 8636 raft_consensus.cc:729] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:50.730708 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "946ac8237fb5475cab84ce69180e13b0" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:50.748411 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818eae7a6645415e992c25565f7f3b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.743244 8490 tablet_service.cc:1467] Processing CreateTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 (DEFAULT_TABLE table=default.Table_d1b1c2c2ebf944dd90282c4764c63acc [id=dbcf165b445f4ef8a27f2d58ac93b3d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.750857 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.722518 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:50.754662 8278 leader_election.cc:341] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:50.755498 8278 leader_election.cc:302] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:50.757695 8755 raft_consensus.cc:2726] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:50.747968 8636 consensus_queue.cc:260] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.731634 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 756557a37a924bcf9d7c0743beed6a9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:50.732360 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:50.774113 8773 tablet.cc:1722] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:50.766693 8626 ts_tablet_manager.cc:1905] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:50.781512 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 50469.6us
W20260812 19:26:50.782053 8281 leader_election.cc:341] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:50.782931 8107 leader_election.cc:341] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:50.782846 8281 leader_election.cc:302] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:50.785130 8755 raft_consensus.cc:2726] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:50.788508 8495 tablet_service.cc:1467] Processing CreateTablet for tablet eec275b2131d4848ae120d8a841a1cae (DEFAULT_TABLE table=default.Table_77f5368431cf473daab21a349c850ca8 [id=e680e4a33c234a20be57640b6f7c4e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.789323 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 818eae7a6645415e992c25565f7f3b5a (DEFAULT_TABLE table=default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.790252 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818eae7a6645415e992c25565f7f3b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.794155 8491 tablet_service.cc:1467] Processing CreateTablet for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (DEFAULT_TABLE table=default.Table_8ec5028fb16b41b6b3b4d0d7beed88ea [id=0b6d2f95f16a4d4a920b8d568d9a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.796228 8786 ts_tablet_manager.cc:1918] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:50.800663 8786 log.cc:1196] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/decf138a91394c939f686ff127ca7922
I20260812 19:26:50.802850 8786 ts_tablet_manager.cc:1939] T decf138a91394c939f686ff127ca7922 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:50.797648 8627 consensus_queue.cc:260] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:50.803079 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 (DEFAULT_TABLE table=default.Table_d1b1c2c2ebf944dd90282c4764c63acc [id=dbcf165b445f4ef8a27f2d58ac93b3d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.807031 8329 tablet_service.cc:1467] Processing CreateTablet for tablet eec275b2131d4848ae120d8a841a1cae (DEFAULT_TABLE table=default.Table_77f5368431cf473daab21a349c850ca8 [id=e680e4a33c234a20be57640b6f7c4e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.807735 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.808765 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eec275b2131d4848ae120d8a841a1cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.811928 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 133d0846cf1244cf91775af0b1ae9118 (DEFAULT_TABLE table=default.Table_acc40462fc7f4aa18145381334c3f325 [id=d5c42d7392754ff895f4bc07163d2afe]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:50.812965 8820 log.cc:924] Time spent T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.052s user 0.000s sys 0.001s
I20260812 19:26:50.752866 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 818eae7a6645415e992c25565f7f3b5a (DEFAULT_TABLE table=default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.815681 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 818eae7a6645415e992c25565f7f3b5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.761886 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 (DEFAULT_TABLE table=default.Table_d1b1c2c2ebf944dd90282c4764c63acc [id=dbcf165b445f4ef8a27f2d58ac93b3d2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.823357 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.815558 8332 tablet_service.cc:1467] Processing CreateTablet for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (DEFAULT_TABLE table=default.Table_8ec5028fb16b41b6b3b4d0d7beed88ea [id=0b6d2f95f16a4d4a920b8d568d9a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.827009 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:50.828450 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 405387us
I20260812 19:26:50.830461 8701 consensus_queue.cc:1035] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:50.834695 8627 ts_tablet_manager.cc:1428] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.146s user 0.007s sys 0.005s
I20260812 19:26:50.843403 8328 tablet_service.cc:1467] Processing CreateTablet for tablet 133d0846cf1244cf91775af0b1ae9118 (DEFAULT_TABLE table=default.Table_acc40462fc7f4aa18145381334c3f325 [id=d5c42d7392754ff895f4bc07163d2afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.845721 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133d0846cf1244cf91775af0b1ae9118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.846480 8158 tablet_service.cc:1467] Processing CreateTablet for tablet eec275b2131d4848ae120d8a841a1cae (DEFAULT_TABLE table=default.Table_77f5368431cf473daab21a349c850ca8 [id=e680e4a33c234a20be57640b6f7c4e61]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.847678 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eec275b2131d4848ae120d8a841a1cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.856421 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet decf138a91394c939f686ff127ca7922 (table default.Table_8f4b0588af9946aa8241760c94c19731 [id=a42276cd79314914b1b737784de7fd98]) successfully deleted
I20260812 19:26:50.857707 8636 ts_tablet_manager.cc:1428] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.158s user 0.005s sys 0.001s
I20260812 19:26:50.858598 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eec275b2131d4848ae120d8a841a1cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.862021 8822 tablet.cc:1722] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:50.862847 8147 tablet_service.cc:1467] Processing CreateTablet for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (DEFAULT_TABLE table=default.Table_8ec5028fb16b41b6b3b4d0d7beed88ea [id=0b6d2f95f16a4d4a920b8d568d9a05f0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.866714 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.868189 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 133d0846cf1244cf91775af0b1ae9118 (DEFAULT_TABLE table=default.Table_acc40462fc7f4aa18145381334c3f325 [id=d5c42d7392754ff895f4bc07163d2afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:50.869082 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133d0846cf1244cf91775af0b1ae9118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.870270 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 133d0846cf1244cf91775af0b1ae9118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.880776 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:50.880504 8623 consensus_queue.cc:260] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.885565 8636 tablet_bootstrap.cc:492] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:50.885324 7952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8ec5028fb16b41b6b3b4d0d7beed88ea" } new_table_name: "default.Table_ae44aac5695a468ba04978ae918c66b4" modify_external_catalogs: true
I20260812 19:26:50.889520 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d9b34a0091e34fc8b1cb5927605244c5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:50.892455 8798 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.320s user 0.000s sys 0.000s
I20260812 19:26:50.897696 8766 raft_consensus.cc:482] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:50.898468 8766 raft_consensus.cc:504] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:50.903268 8766 leader_election.cc:288] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:50.904455 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_ad6af655b663482b88244d72f58c34c0"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:50.908926 8443 leader_election.cc:341] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: baf3e61bb2ab45d19d3ed0169f0a6cdb
W20260812 19:26:50.909042 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9b34a0091e34fc8b1cb5927605244c5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:50.912766 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6 [id=207aa714585c4a20a2ccb8fc894c04b4]). Expected version 2 got 0
I20260812 19:26:50.920594 7954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_63698336eb614df88eca5031884199fd" } modify_external_catalogs: true
I20260812 19:26:50.921569 7954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_63698336eb614df88eca5031884199fd" } modify_external_catalogs: true
I20260812 19:26:50.925123 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_565297bf6a384bfb86c95a16c2f98f4e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:50.928534 8627 tablet_bootstrap.cc:492] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:50.929200 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_4fce364e6d9545ae96b3b503b1fc5b71" } modify_external_catalogs: true
I20260812 19:26:50.930243 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_4fce364e6d9545ae96b3b503b1fc5b71" } modify_external_catalogs: true
I20260812 19:26:50.938064 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_5e620180d68c4c70be82888448511fa3" } new_table_name: "default.Table_2815136dc6074bab9bcf3a0e4a93fdaa" modify_external_catalogs: true
W20260812 19:26:50.941462 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ad6af655b663482b88244d72f58c34c0 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:50.940331 7962 catalog_manager.cc:5495] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:50.945132 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_565297bf6a384bfb86c95a16c2f98f4e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:50.964915 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet cb55b45c8db944b18d1fcc0ea92dbebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb55b45c8db944b18d1fcc0ea92dbebd already in progress: creating tablet
W20260812 19:26:50.966356 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 756557a37a924bcf9d7c0743beed6a9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 756557a37a924bcf9d7c0743beed6a9d already in progress: creating tablet
I20260812 19:26:50.945145 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
W20260812 19:26:51.001454 7952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f consensus state has no leader
I20260812 19:26:51.001538 7962 catalog_manager.cc:5495] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:51.002830 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_5e620180d68c4c70be82888448511fa3 [id=3c0970afdc834aff921d14ba6ab03647]). Expected version 1 got 0
W20260812 19:26:51.004495 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 174425us
I20260812 19:26:51.005609 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_becd7e0ffc7a45f28e5cdf225a55abbb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:51.006670 8108 leader_election.cc:302] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:51.009857 8701 raft_consensus.cc:2781] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:51.010361 8701 raft_consensus.cc:482] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:51.011037 8701 raft_consensus.cc:3037] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:51.013329 8623 ts_tablet_manager.cc:1428] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.316s user 0.009s sys 0.000s
I20260812 19:26:51.014519 8623 tablet_bootstrap.cc:492] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:26:51.016877 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet a1bd8f6905c24ae19c3370246028f7fd consensus state has no leader
W20260812 19:26:51.009994 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_becd7e0ffc7a45f28e5cdf225a55abbb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.028148 8636 tablet_bootstrap.cc:654] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.032636 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "baf3e61bb2ab45d19d3ed0169f0a6cdb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:50.872123 8626 ts_tablet_manager.cc:1918] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260812 19:26:51.042704 8446 leader_election.cc:341] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: Tablet not RUNNING: STOPPED
I20260812 19:26:51.056773 8446 leader_election.cc:302] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:51.058969 8766 raft_consensus.cc:2726] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:51.060289 8626 log.cc:1196] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/d3be82128696447e85758e8595b7e9e6
I20260812 19:26:51.061301 8626 ts_tablet_manager.cc:1939] T d3be82128696447e85758e8595b7e9e6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
W20260812 19:26:51.072458 8108 leader_election.cc:341] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 946ac8237fb5475cab84ce69180e13b0
I20260812 19:26:51.079248 8108 leader_election.cc:302] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:51.081316 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 69fe5774f8dc46308954e9be54bd92b2
I20260812 19:26:51.084120 8648 raft_consensus.cc:2726] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:51.091717 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:51.093267 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44394
W20260812 19:26:51.096530 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 69fe5774f8dc46308954e9be54bd92b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69fe5774f8dc46308954e9be54bd92b2 already in progress: creating tablet
I20260812 19:26:51.106786 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:51.113559 7945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111) [suppressed 7 similar messages]
I20260812 19:26:51.120635 8627 tablet_bootstrap.cc:654] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.153746 7956 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6 [id=207aa714585c4a20a2ccb8fc894c04b4]). Expected version 2 got 0
I20260812 19:26:51.172328 8784 raft_consensus.cc:482] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:51.173203 8784 raft_consensus.cc:504] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:51.179325 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:51.180298 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:51.184895 8281 leader_election.cc:341] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:51.186949 8784 leader_election.cc:288] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:26:51.210845 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 97314.7us
I20260812 19:26:51.234944 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet d3be82128696447e85758e8595b7e9e6 (table default.Table_720375e2fa9e4667955d0ee24a1e09e9 [id=a50462e739154544ba191948a1e77814]) successfully deleted
W20260812 19:26:51.235862 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 756557a37a924bcf9d7c0743beed6a9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 756557a37a924bcf9d7c0743beed6a9d already in progress: creating tablet
W20260812 19:26:51.238710 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 69fe5774f8dc46308954e9be54bd92b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69fe5774f8dc46308954e9be54bd92b2 already in progress: creating tablet
W20260812 19:26:51.238852 8278 leader_election.cc:341] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:51.253053 8636 tablet_bootstrap.cc:492] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:51.253641 8636 ts_tablet_manager.cc:1397] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.368s user 0.021s sys 0.007s
I20260812 19:26:51.239490 8278 leader_election.cc:302] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:51.277936 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d1b1c2c2ebf944dd90282c4764c63acc" } new_table_name: "default.Table_e13f5860d61746f4b3d9ecda0df98a09" modify_external_catalogs: true
I20260812 19:26:51.275664 7952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_972f4f7d001a49da90d12d0b96a2548e" } new_table_name: "default.Table_cb47cf36fb124675bbc53c97d2faecd9" modify_external_catalogs: true
I20260812 19:26:51.284816 8784 raft_consensus.cc:2726] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:51.285105 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 46301.7us
I20260812 19:26:51.295434 8627 tablet_bootstrap.cc:492] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:51.299209 7954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 2a43b5f9446b4ed4a0349af7d8c16f8f
I20260812 19:26:51.304869 8625 ts_tablet_manager.cc:1918] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:51.305245 8625 log.cc:1196] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/baf3e61bb2ab45d19d3ed0169f0a6cdb
I20260812 19:26:51.306044 8625 ts_tablet_manager.cc:1939] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:51.311343 8636 raft_consensus.cc:348] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.312327 8636 raft_consensus.cc:374] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:51.312649 8636 raft_consensus.cc:729] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:51.313537 8636 consensus_queue.cc:260] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.328583 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet d3be82128696447e85758e8595b7e9e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:46 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:51.331575 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet d3be82128696447e85758e8595b7e9e6 because the tablet was not found. No further retry: Not found: Tablet not found: d3be82128696447e85758e8595b7e9e6
I20260812 19:26:51.332635 7954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_61a5cdb267bc48488c3252251f1e139a" } modify_external_catalogs: true
I20260812 19:26:51.333484 8636 ts_tablet_manager.cc:1428] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.079s user 0.007s sys 0.000s
I20260812 19:26:51.333966 7954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_61a5cdb267bc48488c3252251f1e139a" } modify_external_catalogs: true
I20260812 19:26:51.296011 8627 ts_tablet_manager.cc:1397] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.446s user 0.012s sys 0.008s
I20260812 19:26:51.308252 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:51.336102 8786 tablet_replica.cc:330] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:51.331399 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet b961a688b260424499bef8e6bf62734f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:48 UTC) from {username='slave'} at 127.0.0.1:44394
W20260812 19:26:51.341058 7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 21) took 795 ms (client timeout 1000 ms). Trace:
I20260812 19:26:51.346057 8490 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:51.347405 8626 tablet_replica.cc:330] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:51.348250 8626 raft_consensus.cc:2229] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:51.348829 8626 raft_consensus.cc:2258] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:51.351984 8626 ts_tablet_manager.cc:1905] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:51.354085 8636 tablet_bootstrap.cc:492] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:51.355890 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:51.364096 8491 tablet_service.cc:1467] Processing CreateTablet for tablet d49351be8d2a40109d88b54db11c4489 (DEFAULT_TABLE table=default.Table_b35d6b9c90d24b21890d1b174ae92bdb [id=8c765506f69741cb85ac43172fc40548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.366232 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d49351be8d2a40109d88b54db11c4489. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:51.373591 7952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 5f73e97db5954612ab9dfa21bc435efd consensus state has no leader
I20260812 19:26:51.389533 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 4dc5602ff1c24b6ab561389031d89885 (DEFAULT_TABLE table=default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.391651 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dc5602ff1c24b6ab561389031d89885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.394052 8495 tablet_service.cc:1467] Processing CreateTablet for tablet b7d4a12b9c14415e8449d39663296450 (DEFAULT_TABLE table=default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.395205 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d4a12b9c14415e8449d39663296450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.405895 8490 tablet_service.cc:1467] Processing CreateTablet for tablet 29436abddcab4a46adb5aa0c54f45389 (DEFAULT_TABLE table=default.Table_c5c2449187eb429faa8378da84b0adad [id=ad18f22ffe3f4fa58ed87253a5c6080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.407836 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29436abddcab4a46adb5aa0c54f45389. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:51.341558 7962 rpcz_store.cc:269] 0812 19:26:50.545351 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.549290 (+ 3939us) service_pool.cc:227] Handling call
0812 19:26:51.340987 (+791697us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:51.036335 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:51.036761 (+ 426us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:51.036815 (+ 54us) write_op.cc:435] Acquired schema lock
0812 19:26:51.036829 (+ 14us) tablet.cc:660] Decoding operations
0812 19:26:51.037288 (+ 459us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:51.037324 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:51.037345 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:51.037673 (+ 328us) tablet.cc:699] Row locks acquired
0812 19:26:51.037687 (+ 14us) write_op.cc:260] PREPARE: finished
0812 19:26:51.037793 (+ 106us) write_op.cc:270] Start()
0812 19:26:51.037870 (+ 77us) write_op.cc:276] Timestamp: P: 1786562811037736 usec, L: 0
0812 19:26:51.037885 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:26:51.038427 (+ 542us) log.cc:842] Serialized 912 byte log entry
0812 19:26:51.143601 (+105174us) op_driver.cc:444] REPLICATION: finished
0812 19:26:51.143980 (+ 379us) write_op.cc:301] APPLY: starting
0812 19:26:51.144115 (+ 135us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:51.144352 (+ 237us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:51.144516 (+ 164us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:51.144922 (+ 406us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:51.145232 (+ 310us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:51.145326 (+ 94us) write_op.cc:312] APPLY: finished
0812 19:26:51.145717 (+ 391us) log.cc:842] Serialized 28 byte log entry
0812 19:26:51.146043 (+ 326us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:51.146155 (+ 112us) write_op.cc:454] Released schema lock
0812 19:26:51.146236 (+ 81us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:51.146529 (+ 293us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:51.146569 (+ 40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":115,"apply.run_cpu_time_us":2914,"apply.run_wall_time_us":2905,"mutex_wait_us":18197,"num_ops":2,"prepare.queue_time_us":6839,"prepare.run_cpu_time_us":2246,"prepare.run_wall_time_us":3379,"replication_time_us":105565}]]}
W20260812 19:26:51.420115 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 consensus state has no leader
W20260812 19:26:51.434158 7957 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 23) took 1034 ms (client timeout 1000 ms). Trace:
W20260812 19:26:51.440392 7957 rpcz_store.cc:269] 0812 19:26:50.400392 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.403575 (+ 3183us) service_pool.cc:227] Handling call
0812 19:26:51.434013 (+1030438us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":11}
I20260812 19:26:51.457474 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:51.459939 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_3e9699a08d4b49aa9f6e7b830481562a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:51.355909 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:51.467479 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3e9699a08d4b49aa9f6e7b830481562a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.461346 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8c8ffbb4a5954ff682b11c9b2a1d230f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:51.471870 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 38) took 3418 ms. Trace:
I20260812 19:26:51.472215 8625 rpcz_store.cc:276] 0812 19:26:48.053229 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:48.053444 (+ 215us) service_pool.cc:227] Handling call
0812 19:26:50.255352 (+2201908us) ts_tablet_manager.cc:1145] Deleting tablet baf3e61bb2ab45d19d3ed0169f0a6cdb
0812 19:26:50.255444 (+ 92us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:50.843516 (+588072us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:51.304588 (+461072us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:51.471789 (+167201us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2200917}
I20260812 19:26:51.473709 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 43) took 2840 ms. Trace:
W20260812 19:26:51.472647 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8c8ffbb4a5954ff682b11c9b2a1d230f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.474061 8625 rpcz_store.cc:276] 0812 19:26:48.633025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:48.633294 (+ 269us) service_pool.cc:227] Handling call
0812 19:26:51.473346 (+2840052us) ts_tablet_manager.cc:1145] Deleting tablet ac608059319748a1b34510267c813f47
0812 19:26:51.473422 (+ 76us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:51.473661 (+ 239us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2839030}
W20260812 19:26:51.469997 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.475155 8625 tablet_replica.cc:330] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:51.467335 8798 tablet.cc:1722] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:51.483392 8623 tablet_bootstrap.cc:654] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.486518 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet baf3e61bb2ab45d19d3ed0169f0a6cdb (table default.Table_4219b6e538dd4ae38c115865affc34be [id=09aaec16deb046efb62c0b8f6f3b0ea6]) successfully deleted
W20260812 19:26:51.487363 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet ac608059319748a1b34510267c813f47 because the tablet was not found. No further retry: Not found: Tablet not found: ac608059319748a1b34510267c813f47
I20260812 19:26:51.504657 8786 raft_consensus.cc:2229] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:51.505818 8786 raft_consensus.cc:2258] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:51.509992 7960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_77f5368431cf473daab21a349c850ca8" } modify_external_catalogs: true
I20260812 19:26:51.511029 7960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_77f5368431cf473daab21a349c850ca8" } modify_external_catalogs: true
I20260812 19:26:51.512300 8786 ts_tablet_manager.cc:1905] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:51.489450 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 29436abddcab4a46adb5aa0c54f45389 (DEFAULT_TABLE table=default.Table_c5c2449187eb429faa8378da84b0adad [id=ad18f22ffe3f4fa58ed87253a5c6080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.515470 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29436abddcab4a46adb5aa0c54f45389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.518822 8158 tablet_service.cc:1467] Processing CreateTablet for tablet d49351be8d2a40109d88b54db11c4489 (DEFAULT_TABLE table=default.Table_b35d6b9c90d24b21890d1b174ae92bdb [id=8c765506f69741cb85ac43172fc40548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.520016 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d49351be8d2a40109d88b54db11c4489. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:51.533088 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 207835us
I20260812 19:26:51.520913 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_2fbb3f069baa419896067ac162ca3e8a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:51.542915 8107 consensus_peers.cc:487] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:51.557145 8155 tablet_service.cc:1467] Processing CreateTablet for tablet b7d4a12b9c14415e8449d39663296450 (DEFAULT_TABLE table=default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.558442 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d4a12b9c14415e8449d39663296450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.537181 7956 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:51.561774 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 4dc5602ff1c24b6ab561389031d89885 (DEFAULT_TABLE table=default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.563102 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dc5602ff1c24b6ab561389031d89885. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:51.540563 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2fbb3f069baa419896067ac162ca3e8a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.575556 8636 tablet_bootstrap.cc:654] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.624539 7953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8c8ffbb4a5954ff682b11c9b2a1d230f" } new_table_name: "default.Table_b75ada7352e841db92ad8b1288d4482e" modify_external_catalogs: true
W20260812 19:26:51.633065 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5bfebac9602f494eb19772589992f888 consensus state has no leader
W20260812 19:26:51.621434 8701 consensus_meta.cc:287] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.607s user 0.007s sys 0.011s
I20260812 19:26:51.660324 7952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_9c9d2b97c285484a900a37c33effcecb" } new_table_name: "default.Table_85621ff136c84b2b95ebfc4fdbfa646b" modify_external_catalogs: true
I20260812 19:26:51.661217 8766 raft_consensus.cc:482] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:51.661720 8766 raft_consensus.cc:504] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.663951 8766 leader_election.cc:288] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:51.665990 7960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet eec275b2131d4848ae120d8a841a1cae
I20260812 19:26:51.668761 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:51.671370 8325 tablet_service.cc:1467] Processing CreateTablet for tablet b7d4a12b9c14415e8449d39663296450 (DEFAULT_TABLE table=default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.673167 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7d4a12b9c14415e8449d39663296450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.678109 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336e05589e784e768695439e7dc93b71" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:51.690363 7954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 017b6bfef5f44da0866917e04e2db072
I20260812 19:26:51.693986 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet 017b6bfef5f44da0866917e04e2db072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:51.655998 8701 raft_consensus.cc:504] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.702308 8626 ts_tablet_manager.cc:1918] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:51.702754 8626 log.cc:1196] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/2a43b5f9446b4ed4a0349af7d8c16f8f
I20260812 19:26:51.703540 8626 ts_tablet_manager.cc:1939] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:51.705181 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 017b6bfef5f44da0866917e04e2db072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:51.714776 8625 raft_consensus.cc:2229] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:51.716807 8625 raft_consensus.cc:2258] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:51.723199 8701 leader_election.cc:288] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:51.723263 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_63698336eb614df88eca5031884199fd [id=3e92ad5d601b482aaabc37ffd7e7a9e7]) successfully deleted
I20260812 19:26:51.725747 8625 ts_tablet_manager.cc:1905] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:51.725719 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b961a688b260424499bef8e6bf62734f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:26:51.727084 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet eec275b2131d4848ae120d8a841a1cae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eec275b2131d4848ae120d8a841a1cae already in progress: creating tablet
W20260812 19:26:51.727736 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 017b6bfef5f44da0866917e04e2db072 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 017b6bfef5f44da0866917e04e2db072 already in progress: creating tablet
W20260812 19:26:51.728559 8107 consensus_peers.cc:487] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:51.729143 8107 leader_election.cc:341] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:51.732602 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:51.736589 8636 tablet_bootstrap.cc:492] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:51.737166 8636 ts_tablet_manager.cc:1397] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.383s user 0.013s sys 0.013s
I20260812 19:26:51.741871 8701 raft_consensus.cc:482] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:51.742480 8701 raft_consensus.cc:504] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.745429 8701 leader_election.cc:288] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:51.746958 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_48972fc8f09a42bcb9ce2505d2c93896"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:51.747416 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:51.748790 8107 leader_election.cc:341] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:51.748888 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_48972fc8f09a42bcb9ce2505d2c93896 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.758083 8636 raft_consensus.cc:348] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.759814 8636 raft_consensus.cc:374] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:51.760152 8636 raft_consensus.cc:729] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:51.760962 8636 consensus_queue.cc:260] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.761740 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:51.764813 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet e1198960d8ea400387d189762d9549b6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:51.765997 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:51.767724 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 4dc5602ff1c24b6ab561389031d89885 (DEFAULT_TABLE table=default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.770888 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4dc5602ff1c24b6ab561389031d89885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.528097 8627 raft_consensus.cc:348] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:51.771587 8627 raft_consensus.cc:374] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:51.771907 8627 raft_consensus.cc:729] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:51.773504 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 017b6bfef5f44da0866917e04e2db072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:51.772776 8627 consensus_queue.cc:260] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:51.777284 8332 tablet_service.cc:1467] Processing CreateTablet for tablet d49351be8d2a40109d88b54db11c4489 (DEFAULT_TABLE table=default.Table_b35d6b9c90d24b21890d1b174ae92bdb [id=8c765506f69741cb85ac43172fc40548]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.778535 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "336e05589e784e768695439e7dc93b71" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:51.781424 8636 ts_tablet_manager.cc:1428] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.044s user 0.008s sys 0.000s
I20260812 19:26:51.785697 8443 leader_election.cc:302] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:51.786881 8766 raft_consensus.cc:2726] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:51.789727 8623 tablet_bootstrap.cc:492] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:51.790163 8623 ts_tablet_manager.cc:1397] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.776s user 0.031s sys 0.028s
I20260812 19:26:51.787616 8636 tablet_bootstrap.cc:492] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:51.800519 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 29436abddcab4a46adb5aa0c54f45389 (DEFAULT_TABLE table=default.Table_c5c2449187eb429faa8378da84b0adad [id=ad18f22ffe3f4fa58ed87253a5c6080e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:51.802073 8627 ts_tablet_manager.cc:1428] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.467s user 0.007s sys 0.003s
I20260812 19:26:51.802896 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:51.800650 8623 raft_consensus.cc:348] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:51.803632 8351 raft_consensus.cc:2454] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:51.803872 8623 raft_consensus.cc:374] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:51.804715 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b961a688b260424499bef8e6bf62734f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:51.805299 8352 raft_consensus.cc:3037] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:51.804185 8623 raft_consensus.cc:729] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:51.813205 8623 consensus_queue.cc:260] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:51.815032 8627 tablet_bootstrap.cc:492] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:51.819643 8517 raft_consensus.cc:3037] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:51.820732 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.253:41563
--webserver_interface=127.7.144.253
--webserver_port=39161
--builtin_ntp_servers=127.7.144.212:33593
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--hive_metastore_notification_log_poll_period_seconds=1
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 19:26:51.827908 8623 ts_tablet_manager.cc:1428] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.037s user 0.008s sys 0.000s
I20260812 19:26:51.828809 8623 tablet_bootstrap.cc:492] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:51.843045 8623 tablet_bootstrap.cc:654] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:51.845391 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_46eff941aec8459a8180c13546bf30b5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:51.847055 8636 tablet_bootstrap.cc:654] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:51.847131 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_46eff941aec8459a8180c13546bf30b5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.848861 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_990df3b957234fec971d2f5184745c9e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:51.850274 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_990df3b957234fec971d2f5184745c9e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.855819 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d49351be8d2a40109d88b54db11c4489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:51.856061 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:51.857393 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29436abddcab4a46adb5aa0c54f45389. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:51.857760 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:51.871662 7957 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_736993619204407d83bd0619aee8a645" } modify_external_catalogs: true
I20260812 19:26:51.872249 7957 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_736993619204407d83bd0619aee8a645" } modify_external_catalogs: true
I20260812 19:26:51.877522 8108 leader_election.cc:302] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:26:51.878854 8108 consensus_peers.cc:487] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: decf138a91394c939f686ff127ca7922. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:51.879594 8808 raft_consensus.cc:2781] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:51.879928 8808 raft_consensus.cc:482] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:51.880246 8808 raft_consensus.cc:3037] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:51.899946 8798 tablet.cc:1722] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:51.905645 8808 raft_consensus.cc:504] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.908155 8352 raft_consensus.cc:2454] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:51.921918 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e13f5860d61746f4b3d9ecda0df98a09" } modify_external_catalogs: true
I20260812 19:26:51.922497 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e13f5860d61746f4b3d9ecda0df98a09" } modify_external_catalogs: true
I20260812 19:26:51.936964 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:51.938172 8108 leader_election.cc:302] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:26:51.938581 8107 leader_election.cc:341] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:51.938967 8108 raft_consensus.cc:2670] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260812 19:26:51.939131 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:51.939314 8808 leader_election.cc:288] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:26:51.939683 8354 raft_consensus.cc:3037] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:51.944725 8636 tablet_bootstrap.cc:492] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
W20260812 19:26:51.944859 8108 consensus_peers.cc:487] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:51.945246 8636 ts_tablet_manager.cc:1397] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.158s user 0.009s sys 0.000s
I20260812 19:26:51.950260 8636 raft_consensus.cc:348] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.951184 8636 raft_consensus.cc:374] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:51.951508 8636 raft_consensus.cc:729] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:51.955658 8627 tablet_bootstrap.cc:654] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:51.960638 7945 consensus_peers.cc:487] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 -> Peer 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563): Couldn't send request to peer 1e9a660a0f1e4fc6bc6335b38eece0bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260812 19:26:51.960690 8157 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 66) took 1210 ms. Trace:
I20260812 19:26:51.961019 8157 rpcz_store.cc:276] 0812 19:26:50.750924 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.751398 (+ 474us) service_pool.cc:227] Handling call
0812 19:26:50.814405 (+ 63007us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:50.814598 (+ 193us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:51.693632 (+879034us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:51.959987 (+266355us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:51.960625 (+ 638us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:26:51.952075 8636 consensus_queue.cc:260] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:51.979140 8853 tablet.cc:1722] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260812 19:26:52.004657 7953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 96839764810f4b7e9b3dd7a64be85dd1 has no consensus state
I20260812 19:26:52.005669 8354 raft_consensus.cc:2454] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:52.007753 8625 ts_tablet_manager.cc:1918] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:52.013329 8108 leader_election.cc:302] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:52.015179 8808 raft_consensus.cc:2781] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.015410 8490 tablet_service.cc:1467] Processing CreateTablet for tablet da5f9e7431654d5fbae5d554c6f14569 (DEFAULT_TABLE table=default.Table_ad6af655b663482b88244d72f58c34c0 [id=a703135c7fcc446fba1a069bbf4c3b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.015730 8808 raft_consensus.cc:686] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:52.008142 8625 log.cc:1196] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/b961a688b260424499bef8e6bf62734f
I20260812 19:26:52.016536 8808 consensus_queue.cc:237] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.017205 8625 ts_tablet_manager.cc:1939] T b961a688b260424499bef8e6bf62734f P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:52.018066 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da5f9e7431654d5fbae5d554c6f14569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.021175 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]). Expected version 1 got 0
I20260812 19:26:52.021448 8325 tablet_service.cc:1467] Processing CreateTablet for tablet da5f9e7431654d5fbae5d554c6f14569 (DEFAULT_TABLE table=default.Table_ad6af655b663482b88244d72f58c34c0 [id=a703135c7fcc446fba1a069bbf4c3b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.022616 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da5f9e7431654d5fbae5d554c6f14569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.025166 8627 tablet_bootstrap.cc:492] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:52.025605 8627 ts_tablet_manager.cc:1397] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.211s user 0.008s sys 0.003s
I20260812 19:26:52.030514 8330 tablet_service.cc:1467] Processing CreateTablet for tablet eaaf04a85946447aa43873e3568aa3a3 (DEFAULT_TABLE table=default.Table_565297bf6a384bfb86c95a16c2f98f4e [id=9b1730bdd60e490cadcc3292926e6f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.031559 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaaf04a85946447aa43873e3568aa3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.023108 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]). Expected version 2 got 0
I20260812 19:26:52.032902 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:52.033972 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb]). Expected version 2 got 0
I20260812 19:26:52.034611 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]). Expected version 2 got 0
I20260812 19:26:52.035063 8491 tablet_service.cc:1467] Processing CreateTablet for tablet eaaf04a85946447aa43873e3568aa3a3 (DEFAULT_TABLE table=default.Table_565297bf6a384bfb86c95a16c2f98f4e [id=9b1730bdd60e490cadcc3292926e6f96]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:52.035775 7952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 68583d63475a495ca97f3221825622e2 consensus state has no leader
I20260812 19:26:52.036226 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaaf04a85946447aa43873e3568aa3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.036644 7952 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f73e97db5954612ab9dfa21bc435efd from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:52.038050 7956 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6 [id=207aa714585c4a20a2ccb8fc894c04b4] alter complete (version 2)
I20260812 19:26:52.037918 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 (DEFAULT_TABLE table=default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.039072 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd34ec17d8c4609ad979fab951c8a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.039388 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 (DEFAULT_TABLE table=default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.040498 8701 raft_consensus.cc:482] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:26:52.040894 8495 tablet_service.cc:1467] Processing CreateTablet for tablet dbafc01c482b493a981aed31ce112885 (DEFAULT_TABLE table=default.Table_becd7e0ffc7a45f28e5cdf225a55abbb [id=9c67f412032b44b583e41a660ed0329e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.041023 8701 raft_consensus.cc:504] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.041810 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbafc01c482b493a981aed31ce112885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.041908 8623 tablet_bootstrap.cc:492] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:52.042310 8623 ts_tablet_manager.cc:1397] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.214s user 0.013s sys 0.018s
I20260812 19:26:52.042923 8701 leader_election.cc:288] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:52.044778 8623 raft_consensus.cc:348] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.045408 8623 raft_consensus.cc:374] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.045668 8623 raft_consensus.cc:729] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
W20260812 19:26:52.046406 8107 leader_election.cc:341] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Not found: Tablet not found: e1198960d8ea400387d189762d9549b6
I20260812 19:26:52.046505 8623 consensus_queue.cc:260] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.050172 7956 master_service.cc:946] ReplaceTablet: received request to replace tablet 4dc5602ff1c24b6ab561389031d89885 from {username='slave'} at 127.0.0.1:46888
W20260812 19:26:52.052747 8108 leader_election.cc:341] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: e1198960d8ea400387d189762d9549b6
I20260812 19:26:52.053192 8108 leader_election.cc:302] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:52.054085 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd34ec17d8c4609ad979fab951c8a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.055867 8701 raft_consensus.cc:2726] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:26:52.057331 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 47) took 3364 ms. Trace:
I20260812 19:26:52.058442 8625 rpcz_store.cc:276] 0812 19:26:48.693264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:48.696412 (+ 3148us) service_pool.cc:227] Handling call
0812 19:26:51.474898 (+2778486us) ts_tablet_manager.cc:1145] Deleting tablet b961a688b260424499bef8e6bf62734f
0812 19:26:51.474993 (+ 95us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:51.716598 (+241605us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000b0754. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f983886d352 00007f9838c8326c 00007f9839890cfa 00007f98398c0e10 00007f98398a7e0d 00007f98398a7db9 00007f98398a7d49 00007f98398a7d11 00007f98398a6f3d 0000000000580784
0812 19:26:51.909298 (+192700us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.007513 (+ 98215us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.057267 (+ 49754us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":64822,"spinlock_wait_cycles":400142080,"tablet-delete.queue_time_us":2777299}
I20260812 19:26:52.059988 8493 tablet_service.cc:1514] Processing DeleteTablet for tablet baf3e61bb2ab45d19d3ed0169f0a6cdb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:52.060837 8626 tablet_replica.cc:330] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:52.061527 8626 raft_consensus.cc:2229] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:52.062018 8626 raft_consensus.cc:2258] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:52.063715 8626 ts_tablet_manager.cc:1905] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:52.068624 8798 tablet.cc:1717] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Skipping requested alter to schema version 2, tablet already version 2
I20260812 19:26:52.071228 8625 tablet_replica.cc:330] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:52.072063 8625 raft_consensus.cc:2229] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:52.072221 8156 tablet_service.cc:1467] Processing CreateTablet for tablet eaaf04a85946447aa43873e3568aa3a3 (DEFAULT_TABLE table=default.Table_565297bf6a384bfb86c95a16c2f98f4e [id=9b1730bdd60e490cadcc3292926e6f96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.072618 8625 raft_consensus.cc:2258] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:52.073642 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaaf04a85946447aa43873e3568aa3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.074585 8625 ts_tablet_manager.cc:1905] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:52.027969 8627 raft_consensus.cc:348] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.080426 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 (DEFAULT_TABLE table=default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.079401 8627 raft_consensus.cc:374] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.081627 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1bd34ec17d8c4609ad979fab951c8a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.083357 8636 ts_tablet_manager.cc:1428] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.138s user 0.008s sys 0.000s
I20260812 19:26:52.082129 8627 raft_consensus.cc:729] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.088150 8627 consensus_queue.cc:260] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.094301 8636 tablet_bootstrap.cc:492] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:52.094765 8155 tablet_service.cc:1467] Processing CreateTablet for tablet dbafc01c482b493a981aed31ce112885 (DEFAULT_TABLE table=default.Table_becd7e0ffc7a45f28e5cdf225a55abbb [id=9c67f412032b44b583e41a660ed0329e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.095229 8157 tablet_service.cc:1467] Processing CreateTablet for tablet da5f9e7431654d5fbae5d554c6f14569 (DEFAULT_TABLE table=default.Table_ad6af655b663482b88244d72f58c34c0 [id=a703135c7fcc446fba1a069bbf4c3b96]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.096030 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbafc01c482b493a981aed31ce112885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.103597 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet b961a688b260424499bef8e6bf62734f (table default.Table_089b7ab1b51d425788a8678f7d714ed6 [id=8ec4f22b4fa1428bba045191d2a9d169]) successfully deleted
W20260812 19:26:52.108629 8851 log.cc:924] Time spent T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.112s user 0.001s sys 0.000s
I20260812 19:26:52.115617 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da5f9e7431654d5fbae5d554c6f14569. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.132169 8327 tablet_service.cc:1467] Processing CreateTablet for tablet dbafc01c482b493a981aed31ce112885 (DEFAULT_TABLE table=default.Table_becd7e0ffc7a45f28e5cdf225a55abbb [id=9c67f412032b44b583e41a660ed0329e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:52.140148 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dbafc01c482b493a981aed31ce112885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:52.146577 8798 tablet.cc:1722] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:52.149843 8627 ts_tablet_manager.cc:1428] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.124s user 0.007s sys 0.003s
I20260812 19:26:52.157087 8846 raft_consensus.cc:482] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.158078 8627 tablet_bootstrap.cc:492] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:52.165907 8623 ts_tablet_manager.cc:1428] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.123s user 0.007s sys 0.001s
I20260812 19:26:52.158675 8846 raft_consensus.cc:504] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.136157 8786 ts_tablet_manager.cc:1918] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:52.179462 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77445461e7f24c1e80bedb96b2af5daf" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:52.167975 8623 tablet_bootstrap.cc:492] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:52.182130 8786 log.cc:1196] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/2a43b5f9446b4ed4a0349af7d8c16f8f
I20260812 19:26:52.190181 8863 tablet.cc:1722] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:52.197902 8786 ts_tablet_manager.cc:1939] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
W20260812 19:26:52.200439 8278 leader_election.cc:341] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.201412 8627 tablet_bootstrap.cc:654] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.213423 8784 raft_consensus.cc:482] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.214047 8784 raft_consensus.cc:504] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.219686 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb55b45c8db944b18d1fcc0ea92dbebd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:52.221830 8784 leader_election.cc:288] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:26:52.223973 8281 leader_election.cc:341] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.234019 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77445461e7f24c1e80bedb96b2af5daf" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:52.236282 8281 leader_election.cc:341] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.237074 8281 leader_election.cc:302] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:52.164769 8862 tablet.cc:1722] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:52.239593 8864 raft_consensus.cc:2726] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.247603 8846 leader_election.cc:288] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:52.262512 8786 tablet_replica.cc:330] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:52.263379 8786 raft_consensus.cc:2229] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:52.263845 8786 raft_consensus.cc:2258] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:52.278959 8623 tablet_bootstrap.cc:654] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.290632 8766 raft_consensus.cc:482] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.291384 8766 raft_consensus.cc:504] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.295077 8766 leader_election.cc:288] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:52.299796 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:52.290359 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb55b45c8db944b18d1fcc0ea92dbebd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:52.305490 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_63698336eb614df88eca5031884199fd [id=3e92ad5d601b482aaabc37ffd7e7a9e7]) successfully deleted
I20260812 19:26:52.314410 8626 ts_tablet_manager.cc:1918] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:52.314807 8626 log.cc:1196] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/baf3e61bb2ab45d19d3ed0169f0a6cdb
I20260812 19:26:52.315584 8626 ts_tablet_manager.cc:1939] T baf3e61bb2ab45d19d3ed0169f0a6cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:52.315587 8808 raft_consensus.cc:482] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.316318 8808 raft_consensus.cc:504] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.323060 8636 tablet_bootstrap.cc:654] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.328059 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:52.329819 8107 leader_election.cc:341] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.330191 8786 ts_tablet_manager.cc:1905] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:52.330505 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet baf3e61bb2ab45d19d3ed0169f0a6cdb (table default.Table_4219b6e538dd4ae38c115865affc34be [id=09aaec16deb046efb62c0b8f6f3b0ea6]) successfully deleted
I20260812 19:26:52.330881 8808 leader_election.cc:288] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:52.342011 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:52.343015 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]). Expected version 2 got 0
I20260812 19:26:52.345475 8623 tablet_bootstrap.cc:492] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:52.345988 8623 ts_tablet_manager.cc:1397] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.178s user 0.008s sys 0.009s
W20260812 19:26:52.346464 8278 leader_election.cc:341] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.346910 8278 leader_election.cc:302] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:52.350703 8846 raft_consensus.cc:2726] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.352200 8623 raft_consensus.cc:348] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.353005 8623 raft_consensus.cc:374] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.353276 8623 raft_consensus.cc:729] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.283655 7955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_acc40462fc7f4aa18145381334c3f325" } new_table_name: "default.Table_5d0cb80bf27c4cfd840e525eab3c35fd" modify_external_catalogs: true
I20260812 19:26:52.354045 8623 consensus_queue.cc:260] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.355679 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dab1e77a362d483788ac38318df3b58a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:52.357265 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:52.357960 8623 ts_tablet_manager.cc:1428] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.012s user 0.003s sys 0.002s
I20260812 19:26:52.357975 8353 raft_consensus.cc:2454] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:52.358839 8623 tablet_bootstrap.cc:492] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:52.365090 8627 tablet_bootstrap.cc:492] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:52.365262 8354 raft_consensus.cc:2379] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:26:52.366010 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]). Expected version 1 got 0
I20260812 19:26:52.366611 8636 tablet_bootstrap.cc:492] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:52.367090 8636 ts_tablet_manager.cc:1397] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.273s user 0.012s sys 0.005s
I20260812 19:26:52.367367 8108 leader_election.cc:302] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:52.368631 8443 leader_election.cc:302] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:52.368993 7954 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 1 got 0
I20260812 19:26:52.369624 7954 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]). Expected version 1 got 0
I20260812 19:26:52.369710 8808 raft_consensus.cc:2781] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.369549 8636 raft_consensus.cc:348] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.370033 8808 raft_consensus.cc:482] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.370221 8636 raft_consensus.cc:374] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.370328 8808 raft_consensus.cc:3037] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.370474 8636 raft_consensus.cc:729] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.371078 8636 consensus_queue.cc:260] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.376174 8853 tablet.cc:1717] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Skipping requested alter to schema version 2, tablet already version 2
I20260812 19:26:52.376500 8766 raft_consensus.cc:3037] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.365526 8627 ts_tablet_manager.cc:1397] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.209s user 0.010s sys 0.012s
I20260812 19:26:52.382849 8627 raft_consensus.cc:348] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.383570 8627 raft_consensus.cc:374] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.383814 8627 raft_consensus.cc:729] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.396658 8627 consensus_queue.cc:260] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.417804 8625 ts_tablet_manager.cc:1918] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:52.418329 8625 log.cc:1196] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/946ac8237fb5475cab84ce69180e13b0
I20260812 19:26:52.419133 8625 ts_tablet_manager.cc:1939] T 946ac8237fb5475cab84ce69180e13b0 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:52.422677 8862 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:44394 (request call id 70) took 1195 ms. Trace:
I20260812 19:26:52.425568 8627 ts_tablet_manager.cc:1428] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.045s user 0.002s sys 0.004s
I20260812 19:26:52.426677 8627 tablet_bootstrap.cc:492] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:52.442420 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 48) took 3741 ms. Trace:
I20260812 19:26:52.442910 8625 rpcz_store.cc:276] 0812 19:26:48.701520 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:48.704609 (+ 3089us) service_pool.cc:227] Handling call
0812 19:26:52.071010 (+3366401us) ts_tablet_manager.cc:1145] Deleting tablet 946ac8237fb5475cab84ce69180e13b0
0812 19:26:52.071077 (+ 67us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:52.316556 (+245479us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.417517 (+100961us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.442337 (+ 24820us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3365189}
I20260812 19:26:52.445101 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 57) took 2752 ms. Trace:
I20260812 19:26:52.445204 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 946ac8237fb5475cab84ce69180e13b0 (table default.Table_93219d4aa801471ab3650eb30f289b21 [id=1c3e047dba584132ba65b5c2db357a33]) successfully deleted
I20260812 19:26:52.446646 8766 raft_consensus.cc:2726] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.448398 8625 rpcz_store.cc:276] 0812 19:26:49.695972 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:49.696189 (+ 217us) service_pool.cc:227] Handling call
0812 19:26:52.444633 (+2748444us) ts_tablet_manager.cc:1145] Deleting tablet 77445461e7f24c1e80bedb96b2af5daf
0812 19:26:52.444691 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:52.445052 (+ 361us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2747414}
I20260812 19:26:52.449560 8625 tablet_replica.cc:330] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
W20260812 19:26:52.450011 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 77445461e7f24c1e80bedb96b2af5daf because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 77445461e7f24c1e80bedb96b2af5daf already in progress: creating tablet
I20260812 19:26:52.450269 8625 raft_consensus.cc:2229] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:52.451062 8808 raft_consensus.cc:504] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.455637 8808 leader_election.cc:288] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:52.456616 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:52.460310 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:52.461237 8354 raft_consensus.cc:3037] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:52.465103 8107 leader_election.cc:341] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.471561 8625 raft_consensus.cc:2258] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:52.473237 8623 tablet_bootstrap.cc:654] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.478605 8627 tablet_bootstrap.cc:654] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.423420 8862 rpcz_store.cc:276] 0812 19:26:51.227779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.228087 (+ 308us) service_pool.cc:227] Handling call
0812 19:26:52.422561 (+1194474us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:51.272681 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0812 19:26:51.307733 (+ 35052us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0812 19:26:51.307788 (+ 55us) alter_schema_op.cc:65] Acquired schema lock
0812 19:26:51.307857 (+ 69us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0812 19:26:51.308110 (+ 253us) alter_schema_op.cc:126] START. Timestamp: 1786562811307970
0812 19:26:51.308170 (+ 60us) op_driver.cc:331] REPLICATION: starting
0812 19:26:51.309204 (+ 1034us) log.cc:842] Serialized 173 byte log entry
0812 19:26:52.068018 (+758814us) op_driver.cc:444] REPLICATION: finished
0812 19:26:52.162391 (+ 94373us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0812 19:26:52.243604 (+ 81213us) log.cc:842] Serialized 5 byte log entry
0812 19:26:52.419853 (+176249us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.422027 (+ 2174us) log.cc:842] Serialized 14 byte log entry
0812 19:26:52.422288 (+ 261us) alter_schema_op.cc:71] Released schema lock
0812 19:26:52.422345 (+ 57us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":93858,"mutex_wait_us":61562,"prepare.queue_time_us":42960,"prepare.run_cpu_time_us":4406,"prepare.run_wall_time_us":309344,"raft.queue_time_us":254360,"raft.run_cpu_time_us":1218,"raft.run_wall_time_us":1217,"replication_time_us":759720,"thread_start_us":300235,"threads_started":2,"wal-append.queue_time_us":202245}]]}
I20260812 19:26:52.474195 8625 ts_tablet_manager.cc:1905] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:52.496501 8636 ts_tablet_manager.cc:1428] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.129s user 0.007s sys 0.001s
I20260812 19:26:52.497836 8636 tablet_bootstrap.cc:492] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:52.531670 8354 raft_consensus.cc:2454] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:52.534490 8108 leader_election.cc:302] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:52.534955 8786 ts_tablet_manager.cc:1918] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:52.535622 8786 log.cc:1196] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/b961a688b260424499bef8e6bf62734f
I20260812 19:26:52.536803 8786 ts_tablet_manager.cc:1939] T b961a688b260424499bef8e6bf62734f P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:52.538622 8701 raft_consensus.cc:2781] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.539369 8701 raft_consensus.cc:686] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:52.540763 8701 consensus_queue.cc:237] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.549835 8636 tablet_bootstrap.cc:654] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.556831 8846 raft_consensus.cc:482] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.557679 8846 raft_consensus.cc:504] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.563584 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:52.564069 8846 leader_election.cc:288] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:52.565459 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:52.566256 8627 tablet_bootstrap.cc:492] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:52.566645 8627 ts_tablet_manager.cc:1397] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.140s user 0.005s sys 0.012s
W20260812 19:26:52.568524 8281 leader_election.cc:341] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:52.569489 8278 leader_election.cc:341] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.570156 8278 leader_election.cc:302] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:52.571992 8846 raft_consensus.cc:2726] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.577519 8627 raft_consensus.cc:348] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.582160 8627 raft_consensus.cc:374] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.583035 8627 raft_consensus.cc:729] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.589396 8623 tablet_bootstrap.cc:492] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:52.589890 8623 ts_tablet_manager.cc:1397] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.231s user 0.002s sys 0.018s
I20260812 19:26:52.592975 8627 consensus_queue.cc:260] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.597790 8627 ts_tablet_manager.cc:1428] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.031s user 0.008s sys 0.000s
I20260812 19:26:52.600773 8636 tablet_bootstrap.cc:492] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:52.601231 8636 ts_tablet_manager.cc:1397] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.104s user 0.013s sys 0.004s
I20260812 19:26:52.603730 8636 raft_consensus.cc:348] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.607308 8627 tablet_bootstrap.cc:492] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:52.611222 8515 raft_consensus.cc:3037] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.611829 8636 raft_consensus.cc:374] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.612100 8636 raft_consensus.cc:729] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.612720 8636 consensus_queue.cc:260] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.618273 8636 ts_tablet_manager.cc:1428] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260812 19:26:52.619470 8627 tablet_bootstrap.cc:654] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.620416 8636 tablet_bootstrap.cc:492] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:52.629938 8786 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 73) took 1300 ms. Trace:
I20260812 19:26:52.630158 8636 tablet_bootstrap.cc:654] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.630474 8786 rpcz_store.cc:276] 0812 19:26:51.330056 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.330951 (+ 895us) service_pool.cc:227] Handling call
0812 19:26:52.262311 (+931360us) ts_tablet_manager.cc:1145] Deleting tablet b961a688b260424499bef8e6bf62734f
0812 19:26:52.262392 (+ 81us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:52.446387 (+183995us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.524958 (+ 78571us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.629861 (+104903us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":785545}
I20260812 19:26:52.632052 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet b961a688b260424499bef8e6bf62734f (table default.Table_089b7ab1b51d425788a8678f7d714ed6 [id=8ec4f22b4fa1428bba045191d2a9d169]) successfully deleted
W20260812 19:26:52.633991 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet eec275b2131d4848ae120d8a841a1cae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eec275b2131d4848ae120d8a841a1cae already in progress: creating tablet
I20260812 19:26:52.634305 8869 raft_consensus.cc:482] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.634752 8869 raft_consensus.cc:504] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:52.635848 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet e1198960d8ea400387d189762d9549b6 because the tablet was not found. No further retry: Not found: Tablet not found: e1198960d8ea400387d189762d9549b6
W20260812 19:26:52.637872 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet decf138a91394c939f686ff127ca7922 because the tablet was not found. No further retry: Not found: Tablet not found: decf138a91394c939f686ff127ca7922
I20260812 19:26:52.640914 8701 raft_consensus.cc:482] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.641800 8701 raft_consensus.cc:504] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.645306 8701 leader_election.cc:288] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:52.645964 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:52.646570 8354 raft_consensus.cc:2454] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:52.647759 8108 leader_election.cc:302] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:52.593799 8623 raft_consensus.cc:348] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.648391 8623 raft_consensus.cc:374] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.648653 8623 raft_consensus.cc:729] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.648733 8808 raft_consensus.cc:2781] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:52.649130 8808 raft_consensus.cc:482] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:52.649356 8623 consensus_queue.cc:260] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.651295 8623 ts_tablet_manager.cc:1428] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.061s user 0.005s sys 0.000s
I20260812 19:26:52.649498 8808 raft_consensus.cc:3037] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.661831 7960 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]). Expected version 1 got 0
I20260812 19:26:52.669310 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:52.669612 8869 leader_election.cc:288] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:52.671144 8107 leader_election.cc:341] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.671358 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1bd8f6905c24ae19c3370246028f7fd" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:52.663050 7962 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2fbb3f069baa419896067ac162ca3e8a" } new_table_name: "default.Table_811a3f46c44d4369b3e3cc69871e2db5" modify_external_catalogs: true
I20260812 19:26:52.679914 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_ba69209df0f0461caf32a56c6faa35ed"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:52.686604 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ba69209df0f0461caf32a56c6faa35ed in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:52.690330 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4
I20260812 19:26:52.693418 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:52.693786 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 61fce7b5a9d84718a1ed252f9f5f91d9 consensus state has no leader
I20260812 19:26:52.694869 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:52.698269 7956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 4dc5602ff1c24b6ab561389031d89885
I20260812 19:26:52.698367 7957 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:26:52.699455 8627 tablet_bootstrap.cc:492] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:52.699635 7956 catalog_manager.cc:6565] ReplaceTablet: tablet 4dc5602ff1c24b6ab561389031d89885 deleted and replaced by tablet 30940fe1277e4347941f3525f6448cdb
I20260812 19:26:52.699853 8627 ts_tablet_manager.cc:1397] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.093s user 0.019s sys 0.000s
I20260812 19:26:52.701488 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:52.702265 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:52.702108 8627 raft_consensus.cc:348] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.702998 8627 raft_consensus.cc:374] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.703163 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:52.703302 8627 raft_consensus.cc:729] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.703833 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:52.708269 7955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 133d0846cf1244cf91775af0b1ae9118 consensus state has no leader
I20260812 19:26:52.709381 7954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647] alter complete (version 2)
I20260812 19:26:52.717895 7952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 5f73e97db5954612ab9dfa21bc435efd
I20260812 19:26:52.719223 7952 catalog_manager.cc:6565] ReplaceTablet: tablet 5f73e97db5954612ab9dfa21bc435efd deleted and replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1
I20260812 19:26:52.703899 8627 consensus_queue.cc:260] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.721087 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f73e97db5954612ab9dfa21bc435efd with delete_type TABLET_DATA_DELETED (replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:52.724457 8627 ts_tablet_manager.cc:1428] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260812 19:26:52.718629 8808 raft_consensus.cc:504] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.727998 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:26:52.730733 8107 leader_election.cc:341] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:52.732643 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:52.733181 8354 raft_consensus.cc:3037] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.733243 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a1bd8f6905c24ae19c3370246028f7fd" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:52.736111 8446 leader_election.cc:302] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:52.736960 8869 raft_consensus.cc:2726] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.738202 8786 tablet_replica.cc:330] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:52.738399 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:52.740558 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:52.741305 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f73e97db5954612ab9dfa21bc435efd with delete_type TABLET_DATA_DELETED (replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:52.741771 8354 raft_consensus.cc:2454] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:52.742394 8808 leader_election.cc:288] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:52.731010 8627 tablet_bootstrap.cc:492] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:52.743618 8786 raft_consensus.cc:2229] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:52.744077 8786 raft_consensus.cc:2258] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:52.743472 8108 leader_election.cc:302] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:52.744859 8839 raft_consensus.cc:2781] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:52.750168 8623 tablet_bootstrap.cc:492] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:52.756781 8627 tablet_bootstrap.cc:654] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.756750 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:52.758634 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 946ac8237fb5475cab84ce69180e13b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:52.763531 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f73e97db5954612ab9dfa21bc435efd with delete_type TABLET_DATA_DELETED (replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:52.763885 7953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 22) took 804 ms (client timeout 1000 ms). Trace:
I20260812 19:26:52.764109 8786 ts_tablet_manager.cc:1905] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:52.764230 7953 rpcz_store.cc:269] 0812 19:26:51.959544 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.005633 (+ 46089us) service_pool.cc:227] Handling call
0812 19:26:52.154613 (+148980us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:52.763824 (+609211us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2297,"reported_tablets":11,"spinlock_wait_cycles":299969280}
I20260812 19:26:52.765389 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet b961a688b260424499bef8e6bf62734f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:48 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:52.788919 7962 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e98e0f5b053649f1a5ab315312b37442 has no consensus state
I20260812 19:26:52.789165 8625 ts_tablet_manager.cc:1918] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:52.789503 8625 log.cc:1196] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/e1198960d8ea400387d189762d9549b6
I20260812 19:26:52.790413 8625 ts_tablet_manager.cc:1939] T e1198960d8ea400387d189762d9549b6 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:52.792203 7954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_3750cdaa1c8a4721bec69106a1744794 [id=a7e6cd0f83cc491cb3f68098aab6dbab] alter complete (version 1)
I20260812 19:26:52.797825 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 77445461e7f24c1e80bedb96b2af5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:52.806007 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:52.810479 8839 raft_consensus.cc:686] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:52.817510 8839 consensus_queue.cc:237] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:52.825089 8627 tablet_bootstrap.cc:492] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:52.827966 8627 ts_tablet_manager.cc:1397] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.095s user 0.015s sys 0.000s
W20260812 19:26:52.828320 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 already in progress: creating tablet
W20260812 19:26:52.829288 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 4dc5602ff1c24b6ab561389031d89885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dc5602ff1c24b6ab561389031d89885 already in progress: creating tablet
W20260812 19:26:52.830030 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 already in progress: creating tablet
W20260812 19:26:52.830691 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 5f73e97db5954612ab9dfa21bc435efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f73e97db5954612ab9dfa21bc435efd already in progress: creating tablet
I20260812 19:26:52.832600 8627 raft_consensus.cc:348] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.833387 8627 raft_consensus.cc:374] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:52.835116 8623 tablet_bootstrap.cc:654] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.833665 8627 raft_consensus.cc:729] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.841959 8627 consensus_queue.cc:260] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:52.846812 8627 ts_tablet_manager.cc:1428] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.018s user 0.007s sys 0.001s
I20260812 19:26:52.847919 8627 tablet_bootstrap.cc:492] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:52.858351 8636 tablet_bootstrap.cc:492] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:52.858450 8786 ts_tablet_manager.cc:1918] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:52.858947 8636 ts_tablet_manager.cc:1397] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.239s user 0.020s sys 0.009s
I20260812 19:26:52.863905 8786 log.cc:1196] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/017b6bfef5f44da0866917e04e2db072
I20260812 19:26:52.865890 8786 ts_tablet_manager.cc:1939] T 017b6bfef5f44da0866917e04e2db072 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:52.869414 8786 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 82) took 1174 ms. Trace:
I20260812 19:26:52.873014 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_31dfaae147b14328ac0954f3d80620da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:52.873008 8627 tablet_bootstrap.cc:654] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.877970 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_51be1383bed6496b9c5bd3f1f63d728f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:52.873299 8786 rpcz_store.cc:276] 0812 19:26:51.695479 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.772476 (+ 76997us) service_pool.cc:227] Handling call
0812 19:26:52.738029 (+965553us) ts_tablet_manager.cc:1145] Deleting tablet 017b6bfef5f44da0866917e04e2db072
0812 19:26:52.738075 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:52.820949 (+ 82874us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.858218 (+ 37269us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.869354 (+ 11136us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":964094}
I20260812 19:26:52.886834 8517 raft_consensus.cc:3037] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:52.886660 8701 consensus_queue.cc:1035] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:52.895330 8869 raft_consensus.cc:482] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:52.896158 8869 raft_consensus.cc:504] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.900707 8869 leader_election.cc:288] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:52.894104 8636 raft_consensus.cc:348] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:52.905308 8446 leader_election.cc:341] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 946ac8237fb5475cab84ce69180e13b0
I20260812 19:26:52.902118 8636 raft_consensus.cc:374] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:26:52.909261 8443 leader_election.cc:341] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 946ac8237fb5475cab84ce69180e13b0
I20260812 19:26:52.910068 8443 leader_election.cc:302] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:52.911456 7953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed" } modify_external_catalogs: true
I20260812 19:26:52.912479 7953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed" } modify_external_catalogs: true
I20260812 19:26:52.923866 8786 tablet_replica.cc:330] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:52.925434 7952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d" } modify_external_catalogs: true
I20260812 19:26:52.908648 8636 raft_consensus.cc:729] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:52.926505 7952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d" } modify_external_catalogs: true
I20260812 19:26:52.930197 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_659a9b2148dd4d55a121a8c2e0a5881a" } new_table_name: "default.Table_2b1b92a314d54a538f647f1d6b672b95" modify_external_catalogs: true
I20260812 19:26:52.938416 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_61a721fd804b43e280c455210e7cabd8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:52.941593 8786 raft_consensus.cc:2229] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:52.943822 8786 raft_consensus.cc:2258] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:52.944515 8636 consensus_queue.cc:260] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:52.945690 8766 raft_consensus.cc:2726] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:52.948886 8636 ts_tablet_manager.cc:1428] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.090s user 0.005s sys 0.004s
I20260812 19:26:52.949961 8636 tablet_bootstrap.cc:492] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:52.986851 8636 tablet_bootstrap.cc:654] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:52.986352 8786 ts_tablet_manager.cc:1905] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:52.992517 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51be1383bed6496b9c5bd3f1f63d728f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:52.881450 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 017b6bfef5f44da0866917e04e2db072 (table default.Table_61a5cdb267bc48488c3252251f1e139a [id=88cdc52eec7c44d992f08f4c170a5489]) successfully deleted
W20260812 19:26:52.995807 7946 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 114398us
W20260812 19:26:52.996685 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 already in progress: creating tablet
W20260812 19:26:52.997308 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 already in progress: creating tablet
W20260812 19:26:52.997875 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 4dc5602ff1c24b6ab561389031d89885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dc5602ff1c24b6ab561389031d89885 already in progress: creating tablet
W20260812 19:26:52.998430 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 5f73e97db5954612ab9dfa21bc435efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f73e97db5954612ab9dfa21bc435efd already in progress: creating tablet
W20260812 19:26:53.005489 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_31dfaae147b14328ac0954f3d80620da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:53.007861 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 60) took 2927 ms. Trace:
I20260812 19:26:53.008275 8625 rpcz_store.cc:276] 0812 19:26:50.081102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.081301 (+ 199us) service_pool.cc:227] Handling call
0812 19:26:52.449380 (+2368079us) ts_tablet_manager.cc:1145] Deleting tablet e1198960d8ea400387d189762d9549b6
0812 19:26:52.449434 (+ 54us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:52.661167 (+211733us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:52.788939 (+127772us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:53.007798 (+218859us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2366841}
I20260812 19:26:53.009907 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet e1198960d8ea400387d189762d9549b6 (table default.Table_950444052d854c34a6f03fe473988bff [id=786445bdb3f24639b52a307912df394d]) successfully deleted
W20260812 19:26:53.010001 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_61a721fd804b43e280c455210e7cabd8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:53.011328 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 62) took 2746 ms. Trace:
I20260812 19:26:53.011799 8625 rpcz_store.cc:276] 0812 19:26:50.328391 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.336348 (+ 7957us) service_pool.cc:227] Handling call
0812 19:26:53.010806 (+2674458us) ts_tablet_manager.cc:1145] Deleting tablet cb55b45c8db944b18d1fcc0ea92dbebd
0812 19:26:53.010876 (+ 70us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:53.011275 (+ 399us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2673811}
I20260812 19:26:53.024833 8627 tablet_bootstrap.cc:492] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:53.025367 8627 ts_tablet_manager.cc:1397] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.178s user 0.004s sys 0.029s
I20260812 19:26:53.032464 7957 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_5d0cb80bf27c4cfd840e525eab3c35fd" } new_table_name: "default.Table_f9028eb48cef4d429e1b9a950161cf59" modify_external_catalogs: true
I20260812 19:26:53.024091 8894 raft_consensus.cc:482] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.037336 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_72d530bd566d4fa889dd5304f5700a9f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:53.037693 8627 raft_consensus.cc:348] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:53.038417 8627 raft_consensus.cc:374] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.038596 8625 tablet_replica.cc:330] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:53.038668 8627 raft_consensus.cc:729] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:26:53.038915 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_72d530bd566d4fa889dd5304f5700a9f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:53.039283 8627 consensus_queue.cc:260] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:53.051857 8894 raft_consensus.cc:504] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.053377 8627 ts_tablet_manager.cc:1428] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.027s user 0.004s sys 0.003s
W20260812 19:26:53.054103 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet cb55b45c8db944b18d1fcc0ea92dbebd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cb55b45c8db944b18d1fcc0ea92dbebd already in progress: creating tablet
I20260812 19:26:53.056927 8627 tablet_bootstrap.cc:492] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:53.066107 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:53.067396 8352 raft_consensus.cc:2454] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:53.070418 8108 leader_election.cc:302] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:53.072546 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:53.079538 8846 raft_consensus.cc:482] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.080231 8846 raft_consensus.cc:504] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:53.039752 8625 raft_consensus.cc:2229] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:53.110678 8627 tablet_bootstrap.cc:654] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.112506 8846 leader_election.cc:288] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:26:53.116865 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b00a037a2567470497e1a751754df345 consensus state has no leader
I20260812 19:26:53.123574 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:53.123526 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 7d660422701a423794416b01cea825b4 (DEFAULT_TABLE table=default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.126716 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 017b6bfef5f44da0866917e04e2db072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:53.128381 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d660422701a423794416b01cea825b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.134677 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 7d660422701a423794416b01cea825b4 (DEFAULT_TABLE table=default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.141656 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d660422701a423794416b01cea825b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.141527 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 (DEFAULT_TABLE table=default.Table_3e9699a08d4b49aa9f6e7b830481562a [id=9d326d6a71a4424494c26dc6095b1649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.143627 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.154011 8325 tablet_service.cc:1467] Processing CreateTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 (DEFAULT_TABLE table=default.Table_3e9699a08d4b49aa9f6e7b830481562a [id=9d326d6a71a4424494c26dc6095b1649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.159310 8625 raft_consensus.cc:2258] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:53.114274 8894 leader_election.cc:288] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:53.163898 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 96839764810f4b7e9b3dd7a64be85dd1 (DEFAULT_TABLE table=default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.165192 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96839764810f4b7e9b3dd7a64be85dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.160825 8839 raft_consensus.cc:2781] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:53.169008 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:53.173904 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 (DEFAULT_TABLE table=default.Table_3e9699a08d4b49aa9f6e7b830481562a [id=9d326d6a71a4424494c26dc6095b1649]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.180440 8490 tablet_service.cc:1467] Processing CreateTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 (DEFAULT_TABLE table=default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a [id=c7693e18a1794f2391e8364b84c09f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.182622 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.184784 8155 tablet_service.cc:1467] Processing CreateTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 (DEFAULT_TABLE table=default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a [id=c7693e18a1794f2391e8364b84c09f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.185220 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.186354 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:53.161176 8107 leader_election.cc:341] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.176849 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 96839764810f4b7e9b3dd7a64be85dd1 (DEFAULT_TABLE table=default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.190007 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96839764810f4b7e9b3dd7a64be85dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.191941 8493 tablet_service.cc:1467] Processing CreateTablet for tablet e98e0f5b053649f1a5ab315312b37442 (DEFAULT_TABLE table=default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.161067 8846 raft_consensus.cc:482] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.171659 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 7d660422701a423794416b01cea825b4 (DEFAULT_TABLE table=default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.195334 8846 raft_consensus.cc:504] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:53.197717 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d660422701a423794416b01cea825b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.200429 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e98e0f5b053649f1a5ab315312b37442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.201180 8786 ts_tablet_manager.cc:1918] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:53.201838 8786 log.cc:1196] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/77445461e7f24c1e80bedb96b2af5daf
I20260812 19:26:53.202808 8786 ts_tablet_manager.cc:1939] T 77445461e7f24c1e80bedb96b2af5daf P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
W20260812 19:26:53.204792 8281 leader_election.cc:341] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.205294 8627 tablet_bootstrap.cc:492] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:53.205777 8627 ts_tablet_manager.cc:1397] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.149s user 0.008s sys 0.012s
W20260812 19:26:53.160452 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 90253.5us
I20260812 19:26:53.180464 8839 raft_consensus.cc:482] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:53.207502 8839 raft_consensus.cc:3037] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:53.208420 8154 tablet_service.cc:1467] Processing CreateTablet for tablet e98e0f5b053649f1a5ab315312b37442 (DEFAULT_TABLE table=default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.210294 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e98e0f5b053649f1a5ab315312b37442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.230378 8627 raft_consensus.cc:348] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.231211 8627 raft_consensus.cc:374] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.231484 8627 raft_consensus.cc:729] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.231779 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 96839764810f4b7e9b3dd7a64be85dd1 (DEFAULT_TABLE table=default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.232278 8846 leader_election.cc:288] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:53.233402 8846 raft_consensus.cc:482] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.232141 8627 consensus_queue.cc:260] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.235999 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f73e97db5954612ab9dfa21bc435efd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:53.237854 8278 leader_election.cc:341] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.238317 8627 ts_tablet_manager.cc:1428] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.032s user 0.009s sys 0.000s
I20260812 19:26:53.178431 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:53.240625 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.246366 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96839764810f4b7e9b3dd7a64be85dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.248735 8636 tablet_bootstrap.cc:492] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:53.249352 8636 ts_tablet_manager.cc:1397] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.300s user 0.034s sys 0.018s
W20260812 19:26:53.260087 8278 leader_election.cc:341] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.260553 8278 leader_election.cc:302] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:53.262990 8330 tablet_service.cc:1467] Processing CreateTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 (DEFAULT_TABLE table=default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a [id=c7693e18a1794f2391e8364b84c09f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.264330 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.266842 8332 tablet_service.cc:1467] Processing CreateTablet for tablet e98e0f5b053649f1a5ab315312b37442 (DEFAULT_TABLE table=default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:53.274070 8808 raft_consensus.cc:482] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.277470 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e98e0f5b053649f1a5ab315312b37442. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:53.277597 8808 raft_consensus.cc:504] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.279645 8808 leader_election.cc:288] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:53.281591 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f73e97db5954612ab9dfa21bc435efd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:53.283265 8281 leader_election.cc:341] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.283784 8281 leader_election.cc:302] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:53.272114 8846 raft_consensus.cc:504] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:53.262451 8905 tablet.cc:1722] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:53.311589 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:53.316779 8623 tablet_bootstrap.cc:492] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:53.317312 8623 ts_tablet_manager.cc:1397] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.568s user 0.009s sys 0.006s
W20260812 19:26:53.335070 8107 leader_election.cc:341] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:53.338497 8902 log.cc:924] Time spent T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.093s user 0.002s sys 0.000s
I20260812 19:26:53.368883 7954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_31dfaae147b14328ac0954f3d80620da" } new_table_name: "default.Table_24a63660a17a4b1e92b364bfe17e8b4c" modify_external_catalogs: true
I20260812 19:26:53.370783 8636 raft_consensus.cc:348] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:53.371488 8636 raft_consensus.cc:374] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.371764 8636 raft_consensus.cc:729] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.374979 8625 ts_tablet_manager.cc:1905] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:53.375218 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 77445461e7f24c1e80bedb96b2af5daf (table default.Table_3450db0f15ec43dfb63b86b025614242 [id=23c4b17280f540ddacaf2fe8b08715c9]) successfully deleted
I20260812 19:26:53.378870 7962 master_service.cc:946] ReplaceTablet: received request to replace tablet eec275b2131d4848ae120d8a841a1cae from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:53.375962 8636 consensus_queue.cc:260] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:53.385699 8636 ts_tablet_manager.cc:1428] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.136s user 0.007s sys 0.001s
I20260812 19:26:53.388919 8636 tablet_bootstrap.cc:492] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:53.390612 8623 raft_consensus.cc:348] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.391304 8623 raft_consensus.cc:374] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.391561 8623 raft_consensus.cc:729] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.219950 8839 raft_consensus.cc:504] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.399735 8869 raft_consensus.cc:482] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.400033 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:53.400238 8869 raft_consensus.cc:504] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:26:53.401496 8107 leader_election.cc:341] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.402199 8869 leader_election.cc:288] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:53.404124 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "decf138a91394c939f686ff127ca7922" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:53.422712 8636 tablet_bootstrap.cc:654] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.443225 8636 tablet_bootstrap.cc:492] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:53.443642 8636 ts_tablet_manager.cc:1397] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.055s user 0.012s sys 0.001s
I20260812 19:26:53.448455 8636 raft_consensus.cc:348] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.449347 8636 raft_consensus.cc:374] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.449666 8636 raft_consensus.cc:729] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.450771 8636 consensus_queue.cc:260] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.365568 8906 raft_consensus.cc:2726] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:53.440202 8839 leader_election.cc:288] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:53.374019 8627 tablet_bootstrap.cc:492] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:53.456559 8623 consensus_queue.cc:260] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.459234 8636 ts_tablet_manager.cc:1428] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.015s user 0.005s sys 0.005s
I20260812 19:26:53.460316 8636 tablet_bootstrap.cc:492] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:26:53.461545 7957 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 133d0846cf1244cf91775af0b1ae9118 consensus state has no leader
I20260812 19:26:53.369599 8786 tablet_replica.cc:330] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:53.368633 8904 raft_consensus.cc:2726] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:53.469722 8786 raft_consensus.cc:2229] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:53.470588 8786 raft_consensus.cc:2258] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:53.481998 8636 tablet_bootstrap.cc:654] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.484141 7962 master_service.cc:946] ReplaceTablet: received request to replace tablet 1bd34ec17d8c4609ad979fab951c8a96 from {username='slave'} at 127.0.0.1:46888
W20260812 19:26:53.376523 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 116473us
I20260812 19:26:53.494508 8786 ts_tablet_manager.cc:1905] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:53.496820 8869 raft_consensus.cc:482] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.497726 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:53.497650 8869 raft_consensus.cc:504] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:26:53.498908 8352 raft_consensus.cc:2454] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:53.504331 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fe5774f8dc46308954e9be54bd92b2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:53.505336 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_681d711e15c94b50aa934a15d1ffee5f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:53.507160 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_681d711e15c94b50aa934a15d1ffee5f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:53.512466 8446 leader_election.cc:341] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: b961a688b260424499bef8e6bf62734f
I20260812 19:26:53.520227 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:53.521341 8354 raft_consensus.cc:3037] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:53.520663 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8d0e87a9ef4c4bdab9558d30c7597948"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:53.523947 8869 leader_election.cc:288] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:53.524463 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d0e87a9ef4c4bdab9558d30c7597948 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:53.529692 8443 leader_election.cc:341] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: decf138a91394c939f686ff127ca7922
I20260812 19:26:53.530012 8108 leader_election.cc:302] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:53.530527 8443 leader_election.cc:302] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:53.532671 8869 raft_consensus.cc:2726] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:53.535594 8910 raft_consensus.cc:2781] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:53.536104 8910 raft_consensus.cc:482] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:53.536634 8910 raft_consensus.cc:3037] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:53.540738 8636 tablet_bootstrap.cc:492] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:53.541326 8636 ts_tablet_manager.cc:1397] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.081s user 0.014s sys 0.009s
I20260812 19:26:53.545483 8636 raft_consensus.cc:348] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.546497 8636 raft_consensus.cc:374] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.546855 8636 raft_consensus.cc:729] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.548026 8636 consensus_queue.cc:260] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.514168 8623 ts_tablet_manager.cc:1428] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.197s user 0.005s sys 0.002s
W20260812 19:26:53.553968 8107 consensus_peers.cc:487] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:53.555738 8636 ts_tablet_manager.cc:1428] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.014s user 0.010s sys 0.000s
I20260812 19:26:53.555588 8894 consensus_queue.cc:1035] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:53.558359 8636 tablet_bootstrap.cc:492] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:53.566897 8623 tablet_bootstrap.cc:492] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:26:53.570216 8905 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.259s user 0.001s sys 0.000s
I20260812 19:26:53.575177 8636 tablet_bootstrap.cc:654] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.584443 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_e5f2201cb9bd40ed8267caf59450abca"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:53.587013 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e5f2201cb9bd40ed8267caf59450abca in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:53.591612 8636 tablet_bootstrap.cc:492] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:53.592154 8636 ts_tablet_manager.cc:1397] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.020s
I20260812 19:26:53.596004 8636 raft_consensus.cc:348] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.596890 8636 raft_consensus.cc:374] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.597175 8636 raft_consensus.cc:729] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.598212 8636 consensus_queue.cc:260] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.600965 8636 ts_tablet_manager.cc:1428] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260812 19:26:53.602051 8636 tablet_bootstrap.cc:492] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:53.612792 8636 tablet_bootstrap.cc:654] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.630378 8636 tablet_bootstrap.cc:492] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:53.630908 8636 ts_tablet_manager.cc:1397] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.029s user 0.000s sys 0.024s
I20260812 19:26:53.635144 8636 raft_consensus.cc:348] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.635995 8636 raft_consensus.cc:374] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.636438 8636 raft_consensus.cc:729] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.637362 8636 consensus_queue.cc:260] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.640888 8636 ts_tablet_manager.cc:1428] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.010s user 0.008s sys 0.003s
I20260812 19:26:53.641865 8636 tablet_bootstrap.cc:492] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:53.643432 8869 raft_consensus.cc:482] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.644140 8869 raft_consensus.cc:504] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.645570 8625 ts_tablet_manager.cc:1918] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:53.646060 8625 log.cc:1196] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/d3be82128696447e85758e8595b7e9e6
I20260812 19:26:53.647027 8625 ts_tablet_manager.cc:1939] T d3be82128696447e85758e8595b7e9e6 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:53.650714 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:53.658768 8869 leader_election.cc:288] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:53.659808 8869 raft_consensus.cc:482] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.660828 8869 raft_consensus.cc:504] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.362987 8846 leader_election.cc:288] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:26:53.675083 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 391720us
I20260812 19:26:53.676496 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_51be1383bed6496b9c5bd3f1f63d728f" } new_table_name: "default.Table_4f6e1ed970454d05afe6de4cbae88fd6" modify_external_catalogs: true
I20260812 19:26:53.680418 8627 tablet_bootstrap.cc:654] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.686640 8846 raft_consensus.cc:482] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.687372 8846 raft_consensus.cc:504] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.689250 8869 leader_election.cc:288] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:53.691661 8846 leader_election.cc:288] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:53.706234 8354 raft_consensus.cc:2454] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
W20260812 19:26:53.717531 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 5bfebac9602f494eb19772589992f888 consensus state has no leader
I20260812 19:26:53.649983 8910 raft_consensus.cc:504] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:26:53.724668 8278 leader_election.cc:341] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.731982 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:53.735332 8636 tablet_bootstrap.cc:654] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:53.735842 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 140893us
I20260812 19:26:53.739320 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fe5774f8dc46308954e9be54bd92b2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:53.754072 8623 tablet_bootstrap.cc:654] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.754396 7956 catalog_manager.cc:5495] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:53.757263 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 63) took 3138 ms. Trace:
I20260812 19:26:53.757802 8625 rpcz_store.cc:276] 0812 19:26:50.618887 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.619051 (+ 164us) service_pool.cc:227] Handling call
0812 19:26:53.038449 (+2419398us) ts_tablet_manager.cc:1145] Deleting tablet d3be82128696447e85758e8595b7e9e6
0812 19:26:53.038490 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:53.569870 (+531380us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:53.644047 (+ 74177us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:53.757191 (+113144us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2418180}
I20260812 19:26:53.757092 7956 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]). Expected version 2 got 0
I20260812 19:26:53.759584 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 64) took 3138 ms. Trace:
I20260812 19:26:53.763562 8625 rpcz_store.cc:276] 0812 19:26:50.621256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.625627 (+ 4371us) service_pool.cc:227] Handling call
0812 19:26:53.759127 (+3133500us) ts_tablet_manager.cc:1145] Deleting tablet 33bcf8d54395461d9eb07965966153a1
0812 19:26:53.759193 (+ 66us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:53.759515 (+ 322us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3132464}
I20260812 19:26:53.765105 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 65) took 3034 ms. Trace:
I20260812 19:26:53.768340 8625 rpcz_store.cc:276] 0812 19:26:50.731271 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:50.731492 (+ 221us) service_pool.cc:227] Handling call
0812 19:26:53.764717 (+3033225us) ts_tablet_manager.cc:1145] Deleting tablet 756557a37a924bcf9d7c0743beed6a9d
0812 19:26:53.764760 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:53.765054 (+ 294us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3001698}
I20260812 19:26:53.768697 7952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet f313502f35a046188c4b24c10b762c7b
I20260812 19:26:53.768904 7956 catalog_manager.cc:5495] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } }
W20260812 19:26:53.774179 7954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet ed3743a7dde744668cbe91759a499805 has no consensus state
I20260812 19:26:53.781466 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d68eb29f287c4321aea950e7e6ded055"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:53.783167 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d68eb29f287c4321aea950e7e6ded055 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:53.792528 7956 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]). Expected version 1 got 0
I20260812 19:26:53.793740 7956 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:53.794742 7953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 5bfebac9602f494eb19772589992f888
I20260812 19:26:53.794592 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet d3be82128696447e85758e8595b7e9e6 (table default.Table_720375e2fa9e4667955d0ee24a1e09e9 [id=a50462e739154544ba191948a1e77814]) successfully deleted
W20260812 19:26:53.797392 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 33bcf8d54395461d9eb07965966153a1 because the tablet was not found. No further retry: Not found: Tablet not found: 33bcf8d54395461d9eb07965966153a1
W20260812 19:26:53.812023 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 756557a37a924bcf9d7c0743beed6a9d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 756557a37a924bcf9d7c0743beed6a9d already in progress: creating tablet
I20260812 19:26:53.761428 8910 leader_election.cc:288] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:53.819604 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet f313502f35a046188c4b24c10b762c7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:53.820295 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfebac9602f494eb19772589992f888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:53.820899 8786 ts_tablet_manager.cc:1918] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:53.821264 8786 log.cc:1196] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/cb55b45c8db944b18d1fcc0ea92dbebd
I20260812 19:26:53.821892 8786 ts_tablet_manager.cc:1939] T cb55b45c8db944b18d1fcc0ea92dbebd P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:53.824702 8786 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 93) took 1019 ms. Trace:
I20260812 19:26:53.824996 8786 rpcz_store.cc:276] 0812 19:26:52.805595 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.805798 (+ 203us) service_pool.cc:227] Handling call
0812 19:26:53.369425 (+563627us) ts_tablet_manager.cc:1145] Deleting tablet cb55b45c8db944b18d1fcc0ea92dbebd
0812 19:26:53.369475 (+ 50us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:53.679879 (+310404us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:53.820678 (+140799us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:53.824641 (+ 3963us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":562876}
I20260812 19:26:53.826258 8786 tablet_replica.cc:330] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:53.826951 8786 raft_consensus.cc:2229] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:53.827461 8786 raft_consensus.cc:2258] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:53.829113 8786 ts_tablet_manager.cc:1905] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:53.789762 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:53.835474 8180 raft_consensus.cc:2379] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:26:53.836380 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet cb55b45c8db944b18d1fcc0ea92dbebd (table default.Table_ef547861981d429baacbb9286c8fc629 [id=27b6a83f08704d199cbb25ab55bc634b]) successfully deleted
I20260812 19:26:53.798310 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet f313502f35a046188c4b24c10b762c7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:53.799132 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfebac9602f494eb19772589992f888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:53.836932 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7764a1ae009142b29d5fb574dca45e21 has no consensus state
I20260812 19:26:53.837731 8910 raft_consensus.cc:482] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:53.838853 8910 raft_consensus.cc:504] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:26:53.846226 8281 leader_election.cc:341] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:53.847397 8281 leader_election.cc:341] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.848151 8627 tablet_bootstrap.cc:492] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:53.848559 8627 ts_tablet_manager.cc:1397] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.602s user 0.032s sys 0.022s
I20260812 19:26:53.848753 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:53.814003 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 71) took 2723 ms. Trace:
I20260812 19:26:53.851279 8627 raft_consensus.cc:348] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.851924 8627 raft_consensus.cc:374] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:53.852146 8627 raft_consensus.cc:729] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:53.852744 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bfebac9602f494eb19772589992f888" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:53.852802 8627 consensus_queue.cc:260] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.853507 8356 raft_consensus.cc:2379] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:26:53.854313 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "355b9f4f5ada428789aa871c888843e1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:53.854890 8627 ts_tablet_manager.cc:1428] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260812 19:26:53.855031 8351 raft_consensus.cc:2379] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:26:53.856132 8108 leader_election.cc:302] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:53.858330 8894 raft_consensus.cc:2781] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:53.858886 8894 raft_consensus.cc:686] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:53.849386 8352 raft_consensus.cc:3037] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:53.859781 8894 consensus_queue.cc:237] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.861716 8627 tablet_bootstrap.cc:492] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:53.851680 8625 rpcz_store.cc:276] 0812 19:26:51.091205 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.091442 (+ 237us) service_pool.cc:227] Handling call
0812 19:26:53.813623 (+2722181us) ts_tablet_manager.cc:1145] Deleting tablet 69fe5774f8dc46308954e9be54bd92b2
0812 19:26:53.813669 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:53.813944 (+ 275us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2721017}
I20260812 19:26:53.864482 8625 tablet_replica.cc:330] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:53.847834 8281 leader_election.cc:302] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:26:53.865370 8281 raft_consensus.cc:2670] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260812 19:26:53.866425 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 69fe5774f8dc46308954e9be54bd92b2 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69fe5774f8dc46308954e9be54bd92b2 already in progress: creating tablet
I20260812 19:26:53.866665 8808 consensus_queue.cc:1035] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:53.872094 8808 consensus_queue.cc:1035] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:53.877163 7955 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]). Expected version 2 got 0
I20260812 19:26:53.873399 8352 raft_consensus.cc:2454] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
W20260812 19:26:53.901875 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 23) took 887 ms (client timeout 1000 ms). Trace:
I20260812 19:26:53.912942 8910 leader_election.cc:288] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:53.914089 8443 leader_election.cc:341] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: b961a688b260424499bef8e6bf62734f
I20260812 19:26:53.916877 8443 leader_election.cc:302] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:53.940383 8443 leader_election.cc:302] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:53.937793 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfebac9602f494eb19772589992f888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:53.941571 8494 tablet_service.cc:1514] Processing DeleteTablet for tablet 946ac8237fb5475cab84ce69180e13b0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:53.942487 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet f313502f35a046188c4b24c10b762c7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:53.943718 8512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:53.944977 8512 raft_consensus.cc:2454] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
W20260812 19:26:53.948616 8927 log.cc:924] Time spent T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.059s user 0.001s sys 0.000s
I20260812 19:26:53.949108 8627 tablet_bootstrap.cc:654] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:53.951506 8108 leader_election.cc:302] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:53.952625 8910 raft_consensus.cc:2781] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 19:26:53.952735 8108 leader_election.cc:341] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 77445461e7f24c1e80bedb96b2af5daf
I20260812 19:26:53.953099 8910 raft_consensus.cc:686] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:53.953955 8910 consensus_queue.cc:237] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.956135 8278 leader_election.cc:302] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:53.957332 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77445461e7f24c1e80bedb96b2af5daf" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:53.958294 8516 raft_consensus.cc:3037] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:53.956931 8911 raft_consensus.cc:2781] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:53.959033 8911 raft_consensus.cc:482] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:53.959442 8911 raft_consensus.cc:3037] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:53.929972 8491 consensus_meta.cc:287] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.550s user 0.011s sys 0.004s
I20260812 19:26:53.973292 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_94076c31f10744b49ed2803dca34a8de" } modify_external_catalogs: true
I20260812 19:26:53.973848 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_94076c31f10744b49ed2803dca34a8de" } modify_external_catalogs: true
W20260812 19:26:53.977816 8107 leader_election.cc:341] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:53.978257 8107 leader_election.cc:302] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:53.979456 8926 raft_consensus.cc:2726] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:53.985627 8911 raft_consensus.cc:504] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:53.988705 7954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_49512314d04b46c2b5c304968d0426a4" } new_table_name: "default.Table_aab7fcc80b1f4c74b682254b2c072364" modify_external_catalogs: true
I20260812 19:26:53.999081 7959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_becd7e0ffc7a45f28e5cdf225a55abbb" } modify_external_catalogs: true
I20260812 19:26:53.999716 7959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_becd7e0ffc7a45f28e5cdf225a55abbb" } modify_external_catalogs: true
I20260812 19:26:54.000450 8869 raft_consensus.cc:482] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.000995 8869 raft_consensus.cc:504] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.003410 8869 leader_election.cc:288] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:54.007725 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d861fc3b700e405facd2ca9375bed373"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:54.009856 8929 log.cc:924] Time spent T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.130s user 0.001s sys 0.000s
I20260812 19:26:54.014801 8933 tablet_replica.cc:330] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:54.016305 8905 tablet.cc:1717] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Skipping requested alter to schema version 2, tablet already version 2
I20260812 19:26:54.019872 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:54.024750 8924 raft_consensus.cc:2726] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:54.027161 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_771c0d6e0724423f812f274ab0c28078"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:54.028997 8623 tablet_bootstrap.cc:492] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:54.029429 8623 ts_tablet_manager.cc:1397] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.463s user 0.012s sys 0.020s
I20260812 19:26:54.037268 8627 tablet_bootstrap.cc:492] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:54.037385 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_b4e937adcb8e460892f60bae170f2219"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:54.037897 8627 ts_tablet_manager.cc:1397] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.176s user 0.014s sys 0.001s
W20260812 19:26:54.040087 8107 leader_election.cc:341] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:53.902230 7956 rpcz_store.cc:269] 0812 19:26:53.014346 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.014585 (+ 239us) service_pool.cc:227] Handling call
0812 19:26:53.901814 (+887229us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:53.832187 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:53.832563 (+ 376us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:53.832592 (+ 29us) write_op.cc:435] Acquired schema lock
0812 19:26:53.832612 (+ 20us) tablet.cc:660] Decoding operations
0812 19:26:53.833112 (+ 500us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:53.833160 (+ 48us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:53.833194 (+ 34us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:53.833478 (+ 284us) tablet.cc:699] Row locks acquired
0812 19:26:53.833496 (+ 18us) write_op.cc:260] PREPARE: finished
0812 19:26:53.833610 (+ 114us) write_op.cc:270] Start()
0812 19:26:53.833702 (+ 92us) write_op.cc:276] Timestamp: P: 1786562813833544 usec, L: 0
0812 19:26:53.833718 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:26:53.834302 (+ 584us) log.cc:842] Serialized 913 byte log entry
0812 19:26:53.863880 (+ 29578us) op_driver.cc:444] REPLICATION: finished
0812 19:26:53.864142 (+ 262us) write_op.cc:301] APPLY: starting
0812 19:26:53.864201 (+ 59us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:53.864329 (+ 128us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:53.864441 (+ 112us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:53.864676 (+ 235us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:53.864936 (+ 260us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:53.864981 (+ 45us) write_op.cc:312] APPLY: finished
0812 19:26:53.865163 (+ 182us) log.cc:842] Serialized 29 byte log entry
0812 19:26:53.865311 (+ 148us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:53.865387 (+ 76us) write_op.cc:454] Released schema lock
0812 19:26:53.865417 (+ 30us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:53.865593 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:53.865618 (+ 25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":84,"apply.run_cpu_time_us":1689,"apply.run_wall_time_us":1688,"num_ops":2,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":2254,"prepare.run_wall_time_us":2378,"raft.queue_time_us":89,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":12,"replication_time_us":30079,"spinlock_wait_cycles":8064}]]}
I20260812 19:26:54.046718 8924 raft_consensus.cc:482] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.047271 8924 raft_consensus.cc:504] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.049376 8924 leader_election.cc:288] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:54.050558 8627 raft_consensus.cc:348] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.051232 8627 raft_consensus.cc:374] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:54.051525 8627 raft_consensus.cc:729] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:54.052170 8627 consensus_queue.cc:260] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.054363 8627 ts_tablet_manager.cc:1428] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.016s user 0.004s sys 0.000s
I20260812 19:26:54.054672 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_f1f45ee21dc442e6a5f4808c0e64778f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:54.058264 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:26:54.060303 8281 leader_election.cc:341] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:54.062148 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:54.062706 8517 raft_consensus.cc:3037] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:54.032054 8623 raft_consensus.cc:348] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.063730 8623 raft_consensus.cc:374] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:54.064935 8911 leader_election.cc:288] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:54.063979 8623 raft_consensus.cc:729] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:54.069790 8623 consensus_queue.cc:260] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.070722 8933 raft_consensus.cc:2229] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:54.071270 8933 raft_consensus.cc:2258] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:54.072834 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d861fc3b700e405facd2ca9375bed373 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:54.074231 8933 ts_tablet_manager.cc:1905] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:54.075977 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b4e937adcb8e460892f60bae170f2219 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:54.076782 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_771c0d6e0724423f812f274ab0c28078 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:54.077521 8623 ts_tablet_manager.cc:1428] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
W20260812 19:26:54.077754 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1f45ee21dc442e6a5f4808c0e64778f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:54.078673 8627 tablet_bootstrap.cc:492] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:54.086462 7956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3750cdaa1c8a4721bec69106a1744794" } new_table_name: "default.Table_f429f2bd365a4d5fa9bd32e3d490473b" modify_external_catalogs: true
I20260812 19:26:54.087033 8846 raft_consensus.cc:482] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.099610 8846 raft_consensus.cc:504] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.101630 8846 leader_election.cc:288] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:54.102128 8846 raft_consensus.cc:482] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.102504 8846 raft_consensus.cc:504] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.106353 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7cfdcedbaf4db7b510dd8e9f5ae867" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:54.108951 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7cfdcedbaf4db7b510dd8e9f5ae867" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:54.107081 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:54.110462 8846 leader_election.cc:288] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:54.110425 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:54.110877 8281 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:54.111548 8281 leader_election.cc:341] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:54.112442 8278 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:54.112886 8623 tablet_bootstrap.cc:492] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:54.112807 8278 leader_election.cc:302] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:26:54.114720 8278 leader_election.cc:341] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:54.115136 8278 leader_election.cc:302] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:54.116384 8904 raft_consensus.cc:2726] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:54.116641 8846 raft_consensus.cc:2726] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:54.136350 8627 tablet_bootstrap.cc:654] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:54.141727 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:54.143021 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:54.130494 8515 raft_consensus.cc:3037] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:54.143735 8839 raft_consensus.cc:482] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.149133 8839 raft_consensus.cc:504] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.151108 8839 leader_election.cc:288] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:54.153098 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb55b45c8db944b18d1fcc0ea92dbebd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:54.154522 8107 leader_election.cc:341] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:54.156769 8446 leader_election.cc:341] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:54.144364 8625 raft_consensus.cc:2229] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:54.158221 8625 pending_rounds.cc:62] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:26:54.158489 8625 pending_rounds.cc:68] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761272773357568 op_type: NO_OP noop_request { }
I20260812 19:26:54.158924 8625 raft_consensus.cc:2866] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:54.159287 8625 raft_consensus.cc:2258] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:54.162475 8839 consensus_queue.cc:1035] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:54.135231 8623 tablet_bootstrap.cc:654] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:54.133517 8488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 84) took 1012 ms. Trace:
I20260812 19:26:54.175905 8488 rpcz_store.cc:276] 0812 19:26:53.121545 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.121841 (+ 296us) service_pool.cc:227] Handling call
0812 19:26:53.127643 (+ 5802us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:53.127785 (+ 142us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:53.567890 (+440105us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.013351 (+445461us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:54.133345 (+119994us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":106172}
W20260812 19:26:54.131861 8443 raft_consensus.cc:2670] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260812 19:26:54.179234 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 238927us
I20260812 19:26:54.188745 8625 ts_tablet_manager.cc:1905] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:54.193517 8443 leader_election.cc:302] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:54.194455 8627 tablet_bootstrap.cc:492] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:54.194859 8627 ts_tablet_manager.cc:1397] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.140s user 0.008s sys 0.001s
I20260812 19:26:54.208050 8869 raft_consensus.cc:3037] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:54.208027 8627 raft_consensus.cc:348] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.208773 8627 raft_consensus.cc:374] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:54.209034 8627 raft_consensus.cc:729] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:54.209647 8627 consensus_queue.cc:260] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.221176 7952 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 1950030ab501429a91971f80f761a172 (table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]). Expected version 1 got 0
I20260812 19:26:54.141284 8491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 85) took 1001 ms. Trace:
I20260812 19:26:54.223645 8491 rpcz_store.cc:276] 0812 19:26:53.139978 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.140227 (+ 249us) service_pool.cc:227] Handling call
0812 19:26:53.142751 (+ 2524us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:53.142938 (+ 187us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:53.379181 (+236243us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.135288 (+756107us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:54.141216 (+ 5928us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:26:54.238976 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f73e97db5954612ab9dfa21bc435efd with delete_type TABLET_DATA_DELETED (replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:54.120231 8517 raft_consensus.cc:2454] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
W20260812 19:26:54.195729 8108 leader_election.cc:341] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd
I20260812 19:26:54.252234 8108 leader_election.cc:302] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:54.253643 8839 raft_consensus.cc:2726] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:54.254920 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 61494.7us
I20260812 19:26:54.249357 8278 leader_election.cc:302] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:54.262037 8911 raft_consensus.cc:2781] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:54.262485 7962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 1bd34ec17d8c4609ad979fab951c8a96
I20260812 19:26:54.263028 8911 raft_consensus.cc:686] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:26:54.264587 8911 consensus_queue.cc:237] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:26:54.276850 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 81142.9us
I20260812 19:26:54.278162 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:54.278620 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:54.283674 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet dab1e77a362d483788ac38318df3b58a
I20260812 19:26:54.286437 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet dab1e77a362d483788ac38318df3b58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:54.290046 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet dab1e77a362d483788ac38318df3b58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:54.288621 8869 raft_consensus.cc:2726] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:54.296842 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 863e7ca808f54a989b3372aa4bfe361e (DEFAULT_TABLE table=default.Table_ba69209df0f0461caf32a56c6faa35ed [id=e7004daceb8248e38a52995d0dff69ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.299650 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863e7ca808f54a989b3372aa4bfe361e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.303253 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f313502f35a046188c4b24c10b762c7b" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:54.304409 7962 catalog_manager.cc:6565] ReplaceTablet: tablet 1bd34ec17d8c4609ad979fab951c8a96 deleted and replaced by tablet c6075b2e46524829962d2b84353013b2
I20260812 19:26:54.305780 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61fce7b5a9d84718a1ed252f9f5f91d9" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:54.308480 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 863e7ca808f54a989b3372aa4bfe361e (DEFAULT_TABLE table=default.Table_ba69209df0f0461caf32a56c6faa35ed [id=e7004daceb8248e38a52995d0dff69ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.310683 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863e7ca808f54a989b3372aa4bfe361e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.313779 8905 tablet.cc:1722] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:54.318800 8443 leader_election.cc:302] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:54.320940 8443 leader_election.cc:302] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:54.322844 7959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet dbafc01c482b493a981aed31ce112885
I20260812 19:26:54.324406 8937 raft_consensus.cc:2726] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:54.325182 8869 raft_consensus.cc:2726] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:54.330977 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet dab1e77a362d483788ac38318df3b58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:54.333587 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:54.335381 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 863e7ca808f54a989b3372aa4bfe361e (DEFAULT_TABLE table=default.Table_ba69209df0f0461caf32a56c6faa35ed [id=e7004daceb8248e38a52995d0dff69ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.341382 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 863e7ca808f54a989b3372aa4bfe361e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.359576 8636 tablet_bootstrap.cc:492] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:54.360338 8636 ts_tablet_manager.cc:1397] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.719s user 0.009s sys 0.018s
I20260812 19:26:54.366845 8636 raft_consensus.cc:348] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.367758 8636 raft_consensus.cc:374] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:54.368157 8636 raft_consensus.cc:729] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:54.368979 8636 consensus_queue.cc:260] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.386579 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_b4e937adcb8e460892f60bae170f2219" } new_table_name: "default.Table_50b2712b6ba44c49ad3692f26f9ee0f7" modify_external_catalogs: true
I20260812 19:26:54.393718 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]). Expected version 2 got 0
I20260812 19:26:54.314297 8627 ts_tablet_manager.cc:1428] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.119s user 0.009s sys 0.000s
I20260812 19:26:54.401222 8627 tablet_bootstrap.cc:492] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:54.318066 8786 ts_tablet_manager.cc:1918] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:54.326627 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:54.405401 8786 log.cc:1196] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/69fe5774f8dc46308954e9be54bd92b2
I20260812 19:26:54.365140 8325 tablet_service.cc:1467] Processing CreateTablet for tablet a49e46c8ba704680bf12423854883b55 (DEFAULT_TABLE table=default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.406352 8786 ts_tablet_manager.cc:1939] T 69fe5774f8dc46308954e9be54bd92b2 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:54.406949 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a49e46c8ba704680bf12423854883b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.367368 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 (DEFAULT_TABLE table=default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.379281 8332 tablet_service.cc:1467] Processing CreateTablet for tablet 30940fe1277e4347941f3525f6448cdb (DEFAULT_TABLE table=default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.413038 8786 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 94) took 1290 ms. Trace:
I20260812 19:26:54.413380 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249da5c0bd73498bbfc8f41e7513a9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.414474 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30940fe1277e4347941f3525f6448cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.413403 8786 rpcz_store.cc:276] 0812 19:26:53.122917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.123334 (+ 417us) service_pool.cc:227] Handling call
0812 19:26:53.825959 (+702625us) ts_tablet_manager.cc:1145] Deleting tablet 69fe5774f8dc46308954e9be54bd92b2
0812 19:26:53.826115 (+ 156us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:54.084603 (+258488us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.317815 (+233212us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.412979 (+ 95164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":701616}
I20260812 19:26:54.421706 8786 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 95) took 1295 ms. Trace:
I20260812 19:26:54.422093 8786 rpcz_store.cc:276] 0812 19:26:53.126238 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.126491 (+ 253us) service_pool.cc:227] Handling call
0812 19:26:54.421446 (+1294955us) ts_tablet_manager.cc:1145] Deleting tablet 017b6bfef5f44da0866917e04e2db072
0812 19:26:54.421490 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:54.421654 (+ 164us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1293902}
I20260812 19:26:54.423180 8786 tablet_replica.cc:330] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:54.423899 8786 raft_consensus.cc:2229] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:54.441560 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 30940fe1277e4347941f3525f6448cdb (DEFAULT_TABLE table=default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.442066 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 (DEFAULT_TABLE table=default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.445077 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30940fe1277e4347941f3525f6448cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.450068 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:54.452999 8786 pending_rounds.cc:62] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Trying to abort 1 pending ops.
I20260812 19:26:54.453280 8786 pending_rounds.cc:68] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761287454109696 op_type: NO_OP noop_request { }
I20260812 19:26:54.453773 8786 raft_consensus.cc:2866] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:54.454077 8786 raft_consensus.cc:2258] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:54.455487 8156 tablet_service.cc:1467] Processing CreateTablet for tablet a49e46c8ba704680bf12423854883b55 (DEFAULT_TABLE table=default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.461521 8627 tablet_bootstrap.cc:654] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:54.465793 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a49e46c8ba704680bf12423854883b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.470289 8625 ts_tablet_manager.cc:1918] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:54.470681 8625 log.cc:1196] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/decf138a91394c939f686ff127ca7922
I20260812 19:26:54.424646 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 69fe5774f8dc46308954e9be54bd92b2 (table default.Table_4fce364e6d9545ae96b3b503b1fc5b71 [id=25842a7a7f6f400a867cc04b5ee0f2fd]) successfully deleted
I20260812 19:26:54.429067 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_82549cc5780a4115ac93fa50541bd102"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:54.478132 7946 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 53513.3us
W20260812 19:26:54.479190 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_82549cc5780a4115ac93fa50541bd102 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:54.437394 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_118fda3ccbbb4a1f9e380936b8ad2002"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:54.479594 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 017b6bfef5f44da0866917e04e2db072 because the tablet was not found. No further retry: Not found: Tablet not found: 017b6bfef5f44da0866917e04e2db072
I20260812 19:26:54.437121 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_c4c3334f5a0b4458b574b4398a96f702"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:54.461364 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_319ca0257ad14c3a8b2c51206f4ad522"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:54.481171 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:54.481442 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_319ca0257ad14c3a8b2c51206f4ad522 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:54.463399 7953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_681d711e15c94b50aa934a15d1ffee5f" } new_table_name: "default.Table_a144bda50c444fd987ca9dbe9d6458b2" modify_external_catalogs: true
I20260812 19:26:54.482393 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 3740799e07f94fe981d395ef8c3d7973 (DEFAULT_TABLE table=default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7 [id=044415e437a041018393bc64b1496166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.483985 8329 tablet_service.cc:1467] Processing CreateTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 (DEFAULT_TABLE table=default.Table_cb47cf36fb124675bbc53c97d2faecd9 [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.477826 8786 ts_tablet_manager.cc:1905] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:54.486294 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c4c3334f5a0b4458b574b4398a96f702 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:26:54.490733 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_118fda3ccbbb4a1f9e380936b8ad2002 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:54.493219 8490 tablet_service.cc:1467] Processing CreateTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 (DEFAULT_TABLE table=default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.493738 8933 ts_tablet_manager.cc:1918] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:54.494704 8933 log.cc:1196] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/5bfebac9602f494eb19772589992f888
I20260812 19:26:54.497723 8492 tablet_service.cc:1467] Processing CreateTablet for tablet 30940fe1277e4347941f3525f6448cdb (DEFAULT_TABLE table=default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.501012 8491 tablet_service.cc:1467] Processing CreateTablet for tablet a49e46c8ba704680bf12423854883b55 (DEFAULT_TABLE table=default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.502928 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249da5c0bd73498bbfc8f41e7513a9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.504164 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30940fe1277e4347941f3525f6448cdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.508545 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 249da5c0bd73498bbfc8f41e7513a9d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.512681 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3740799e07f94fe981d395ef8c3d7973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.515960 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 3740799e07f94fe981d395ef8c3d7973 (DEFAULT_TABLE table=default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7 [id=044415e437a041018393bc64b1496166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.519528 8152 tablet_service.cc:1467] Processing CreateTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 (DEFAULT_TABLE table=default.Table_cb47cf36fb124675bbc53c97d2faecd9 [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.520674 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84bf28a3e174f3b88f8758b09ced1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.528944 8623 tablet_bootstrap.cc:492] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:54.529455 8623 ts_tablet_manager.cc:1397] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.417s user 0.008s sys 0.017s
I20260812 19:26:54.539695 8625 ts_tablet_manager.cc:1939] T decf138a91394c939f686ff127ca7922 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:54.546371 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3740799e07f94fe981d395ef8c3d7973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.554953 8958 tablet.cc:1722] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:54.557919 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84bf28a3e174f3b88f8758b09ced1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.568508 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a49e46c8ba704680bf12423854883b55. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:54.571918 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 0fd84e685b2b4e819f4b61e442828b13 has no consensus state
I20260812 19:26:54.577968 8494 tablet_service.cc:1467] Processing CreateTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 (DEFAULT_TABLE table=default.Table_cb47cf36fb124675bbc53c97d2faecd9 [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:54.578693 8950 log.cc:924] Time spent T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.276s user 0.000s sys 0.010s
I20260812 19:26:54.579186 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84bf28a3e174f3b88f8758b09ced1f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.580724 8905 tablet.cc:1722] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:54.582557 8933 ts_tablet_manager.cc:1939] T 5bfebac9602f494eb19772589992f888 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:54.582707 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 3740799e07f94fe981d395ef8c3d7973 (DEFAULT_TABLE table=default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7 [id=044415e437a041018393bc64b1496166]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:54.583706 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3740799e07f94fe981d395ef8c3d7973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:54.584457 8636 ts_tablet_manager.cc:1428] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.224s user 0.006s sys 0.002s
I20260812 19:26:54.585433 8636 tablet_bootstrap.cc:492] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:54.606664 8955 tablet.cc:1722] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:54.611485 7960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d68eb29f287c4321aea950e7e6ded055" } modify_external_catalogs: true
I20260812 19:26:54.612092 7960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d68eb29f287c4321aea950e7e6ded055" } modify_external_catalogs: true
I20260812 19:26:54.672217 8846 raft_consensus.cc:482] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.672703 8846 raft_consensus.cc:504] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.674564 8846 leader_election.cc:288] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:54.671502 8962 tablet.cc:1722] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:54.680502 8786 ts_tablet_manager.cc:1918] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:54.681051 8786 log.cc:1196] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/f313502f35a046188c4b24c10b762c7b
I20260812 19:26:54.682025 8786 ts_tablet_manager.cc:1939] T f313502f35a046188c4b24c10b762c7b P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:54.691831 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 74) took 3337 ms. Trace:
I20260812 19:26:54.692214 8625 rpcz_store.cc:276] 0812 19:26:51.355108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.355318 (+ 210us) service_pool.cc:227] Handling call
0812 19:26:53.864289 (+2508971us) ts_tablet_manager.cc:1145] Deleting tablet decf138a91394c939f686ff127ca7922
0812 19:26:53.864332 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:54.420920 (+556588us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.470076 (+ 49156us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.691758 (+221682us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":137777,"tablet-delete.queue_time_us":2441289}
I20260812 19:26:54.696894 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet decf138a91394c939f686ff127ca7922 (table default.Table_8f4b0588af9946aa8241760c94c19731 [id=a42276cd79314914b1b737784de7fd98]) successfully deleted
I20260812 19:26:54.697764 8625 tablet_replica.cc:330] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:54.698608 8625 raft_consensus.cc:2229] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:54.699450 8625 raft_consensus.cc:2258] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:54.702083 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:54.704656 8278 leader_election.cc:341] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:54.725656 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 133d0846cf1244cf91775af0b1ae9118 consensus state has no leader
I20260812 19:26:54.728843 8636 tablet_bootstrap.cc:654] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:54.730065 7962 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 538d05c5883d4575b8eb5d42dfb3c246 (table default.Table_aab7fcc80b1f4c74b682254b2c072364 [id=d8d745230100465d86d0374a29aabd7c]). Expected version 1 got 0
I20260812 19:26:54.732678 8964 tablet.cc:1722] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:54.735906 8786 tablet_replica.cc:330] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:54.736886 8786 raft_consensus.cc:2229] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:54.737432 8786 raft_consensus.cc:2258] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:54.736078 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet f313502f35a046188c4b24c10b762c7b (table default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d [id=54b1f58892924c83a98dd0761039f77d]) successfully deleted
I20260812 19:26:54.741310 7962 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]). Expected version 2 got 0
I20260812 19:26:54.744681 8627 tablet_bootstrap.cc:492] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:54.745107 8627 ts_tablet_manager.cc:1397] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.344s user 0.014s sys 0.018s
I20260812 19:26:54.754640 8786 ts_tablet_manager.cc:1905] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:54.764920 8961 tablet.cc:1722] T 336e05589e784e768695439e7dc93b71 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:54.766389 8625 ts_tablet_manager.cc:1905] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:54.769217 8623 raft_consensus.cc:348] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.770231 8623 raft_consensus.cc:374] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:54.770533 8623 raft_consensus.cc:729] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:54.771369 8623 consensus_queue.cc:260] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.783681 7954 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6" } modify_external_catalogs: true
I20260812 19:26:54.784847 8627 raft_consensus.cc:348] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.785681 8627 raft_consensus.cc:374] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:54.785983 8627 raft_consensus.cc:729] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:54.788501 8627 consensus_queue.cc:260] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.798571 8627 ts_tablet_manager.cc:1428] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.053s user 0.009s sys 0.000s
I20260812 19:26:54.799151 8623 ts_tablet_manager.cc:1428] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.269s user 0.000s sys 0.008s
I20260812 19:26:54.799638 8627 tablet_bootstrap.cc:492] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:54.820663 8933 tablet_replica.cc:330] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:54.832991 8933 raft_consensus.cc:2229] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:54.833864 8933 raft_consensus.cc:2258] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:54.834556 8910 consensus_queue.cc:1035] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:54.850984 8623 tablet_bootstrap.cc:492] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:54.866281 8869 raft_consensus.cc:482] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.866863 8869 raft_consensus.cc:504] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.871738 8786 ts_tablet_manager.cc:1918] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:54.872087 8786 log.cc:1196] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/5bfebac9602f494eb19772589992f888
I20260812 19:26:54.872975 8786 ts_tablet_manager.cc:1939] T 5bfebac9602f494eb19772589992f888 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:54.872963 8869 leader_election.cc:288] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:54.878470 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:54.879413 8355 raft_consensus.cc:2454] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:26:54.881150 8933 ts_tablet_manager.cc:1905] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:54.884863 8627 tablet_bootstrap.cc:654] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:54.884944 8443 leader_election.cc:302] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:54.885890 8869 raft_consensus.cc:2781] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:54.886294 8869 raft_consensus.cc:482] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:54.886647 8869 raft_consensus.cc:3037] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:54.866158 8926 consensus_queue.cc:1035] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:54.874651 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:54.894434 8446 leader_election.cc:341] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:54.896214 8970 tablet.cc:1722] T 336e05589e784e768695439e7dc93b71 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:54.903342 8786 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 102) took 1084 ms. Trace:
W20260812 19:26:54.877830 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 206799us
I20260812 19:26:54.903715 8786 rpcz_store.cc:276] 0812 19:26:53.818835 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.820148 (+ 1313us) service_pool.cc:227] Handling call
0812 19:26:54.735707 (+915559us) ts_tablet_manager.cc:1145] Deleting tablet 5bfebac9602f494eb19772589992f888
0812 19:26:54.735747 (+ 40us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:54.825946 (+ 90199us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.871317 (+ 45371us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:54.903281 (+ 31964us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17700,"tablet-delete.queue_time_us":915059}
I20260812 19:26:54.905083 8786 tablet_replica.cc:330] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:54.905789 8786 raft_consensus.cc:2229] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:54.906332 8786 raft_consensus.cc:2258] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:54.906417 8108 consensus_peers.cc:487] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bfebac9602f494eb19772589992f888. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:54.907593 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:54.912899 8786 ts_tablet_manager.cc:1905] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:54.917718 8869 raft_consensus.cc:504] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:54.932090 8281 leader_election.cc:341] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:54.952099 8281 leader_election.cc:302] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:54.955977 8846 raft_consensus.cc:2726] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:54.964114 8786 ts_tablet_manager.cc:1918] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:54.964571 8786 log.cc:1196] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/5f73e97db5954612ab9dfa21bc435efd
I20260812 19:26:54.965270 8786 ts_tablet_manager.cc:1939] T 5f73e97db5954612ab9dfa21bc435efd P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:54.970602 7960 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b33552dbe9074f5da931f7408f810dba
I20260812 19:26:54.971715 7960 master_service.cc:946] ReplaceTablet: received request to replace tablet a1bd8f6905c24ae19c3370246028f7fd from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:54.973763 7954 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6" } modify_external_catalogs: true
I20260812 19:26:54.976680 8846 raft_consensus.cc:482] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:54.977520 8846 raft_consensus.cc:504] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:54.978823 8786 tablet_replica.cc:330] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:54.979784 8786 raft_consensus.cc:2229] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:54.980338 8786 raft_consensus.cc:2258] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:54.983564 8846 leader_election.cc:288] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:54.984948 8786 ts_tablet_manager.cc:1905] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:54.948798 8636 tablet_bootstrap.cc:492] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:55.030387 8636 ts_tablet_manager.cc:1397] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.445s user 0.006s sys 0.018s
I20260812 19:26:54.993731 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756557a37a924bcf9d7c0743beed6a9d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:55.034633 8278 leader_election.cc:341] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.038538 8636 raft_consensus.cc:348] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.045814 8636 raft_consensus.cc:374] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.046216 8636 raft_consensus.cc:729] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:55.047042 8636 consensus_queue.cc:260] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.058683 8636 ts_tablet_manager.cc:1428] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.028s user 0.007s sys 0.002s
I20260812 19:26:55.061826 8636 tablet_bootstrap.cc:492] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:55.063436 8786 ts_tablet_manager.cc:1918] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 19:26:55.063962 8786 log.cc:1196] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/dab1e77a362d483788ac38318df3b58a
I20260812 19:26:55.069368 8786 ts_tablet_manager.cc:1939] T dab1e77a362d483788ac38318df3b58a P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:55.085273 8933 ts_tablet_manager.cc:1918] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:55.086826 8933 log.cc:1196] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/946ac8237fb5475cab84ce69180e13b0
I20260812 19:26:55.088979 8933 ts_tablet_manager.cc:1939] T 946ac8237fb5475cab84ce69180e13b0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:55.089443 8869 leader_election.cc:288] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:55.091069 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:55.091965 8354 raft_consensus.cc:3037] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:55.094156 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 91) took 1156 ms. Trace:
I20260812 19:26:54.905520 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb]) successfully deleted
W20260812 19:26:55.097450 7946 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 191939us
I20260812 19:26:55.098439 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 5f73e97db5954612ab9dfa21bc435efd (table default.Table_cb47cf36fb124675bbc53c97d2faecd9 [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]) successfully deleted
W20260812 19:26:55.099278 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 1bd34ec17d8c4609ad979fab951c8a96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bd34ec17d8c4609ad979fab951c8a96 already in progress: creating tablet
I20260812 19:26:55.105757 8933 rpcz_store.cc:276] 0812 19:26:53.937514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.941187 (+ 3673us) service_pool.cc:227] Handling call
0812 19:26:54.811457 (+870270us) ts_tablet_manager.cc:1145] Deleting tablet 946ac8237fb5475cab84ce69180e13b0
0812 19:26:54.812499 (+ 1042us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.027582 (+215083us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.075881 (+ 48299us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.094057 (+ 18176us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":862850}
I20260812 19:26:55.111274 8933 tablet_replica.cc:330] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:55.114145 8933 raft_consensus.cc:2229] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:55.117378 8354 raft_consensus.cc:2454] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:26:55.122685 8933 raft_consensus.cc:2258] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.125159 8443 leader_election.cc:302] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:55.129597 8933 ts_tablet_manager.cc:1905] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:55.146623 8869 raft_consensus.cc:2781] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:55.150257 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756557a37a924bcf9d7c0743beed6a9d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:55.153939 8869 raft_consensus.cc:686] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
W20260812 19:26:55.163805 8281 leader_election.cc:341] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.164585 8281 leader_election.cc:302] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:55.166049 8846 raft_consensus.cc:2726] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:55.168416 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 112390us
I20260812 19:26:55.188855 8627 tablet_bootstrap.cc:492] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:55.189282 8627 ts_tablet_manager.cc:1397] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.390s user 0.043s sys 0.054s
I20260812 19:26:55.193856 8627 raft_consensus.cc:348] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.194643 8627 raft_consensus.cc:374] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.194918 8627 raft_consensus.cc:729] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:55.195531 8627 consensus_queue.cc:260] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:54.756381 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb]) successfully deleted
W20260812 19:26:55.199260 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 444297us
W20260812 19:26:55.200441 7953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df369d3c4e004c29ac65c5ecf7f8c4cc has no consensus state
I20260812 19:26:55.205296 8977 tablet.cc:1722] T 336e05589e784e768695439e7dc93b71 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:55.209438 8627 ts_tablet_manager.cc:1428] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.020s user 0.009s sys 0.000s
I20260812 19:26:55.210421 8627 tablet_bootstrap.cc:492] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:55.215668 8627 tablet_bootstrap.cc:654] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.221309 8933 ts_tablet_manager.cc:1918] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:55.221840 8933 log.cc:1196] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/f313502f35a046188c4b24c10b762c7b
W20260812 19:26:55.221866 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 28) took 962 ms (client timeout 1000 ms). Trace:
I20260812 19:26:55.222729 8933 ts_tablet_manager.cc:1939] T f313502f35a046188c4b24c10b762c7b P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
W20260812 19:26:55.222436 7956 rpcz_store.cc:269] 0812 19:26:54.259326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.259455 (+ 129us) service_pool.cc:227] Handling call
0812 19:26:54.265402 (+ 5947us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:55.221794 (+956392us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":6077696}
I20260812 19:26:55.198047 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]) successfully deleted
W20260812 19:26:55.224102 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet dbafc01c482b493a981aed31ce112885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbafc01c482b493a981aed31ce112885 already in progress: creating tablet
I20260812 19:26:55.225689 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:55.226434 8786 tablet_replica.cc:330] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:55.227478 8786 raft_consensus.cc:2229] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:55.228049 8786 raft_consensus.cc:2258] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.230060 8786 ts_tablet_manager.cc:1905] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:55.233572 8157 consensus_meta.cc:287] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.544s user 0.009s sys 0.001s
I20260812 19:26:55.231083 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 756557a37a924bcf9d7c0743beed6a9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:55.241151 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 89) took 1321 ms. Trace:
I20260812 19:26:55.241811 8933 rpcz_store.cc:276] 0812 19:26:53.920512 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.942255 (+ 21743us) service_pool.cc:227] Handling call
0812 19:26:55.110967 (+1168712us) ts_tablet_manager.cc:1145] Deleting tablet f313502f35a046188c4b24c10b762c7b
0812 19:26:55.111047 (+ 80us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.171834 (+ 60787us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.221060 (+ 49226us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.241032 (+ 19972us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1168051}
I20260812 19:26:55.246220 8933 tablet_replica.cc:330] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:55.155580 8869 consensus_queue.cc:237] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.256448 8933 raft_consensus.cc:2229] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:55.257509 8933 raft_consensus.cc:2258] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.262549 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:26:55.266428 8107 consensus_peers.cc:487] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:55.274701 8786 ts_tablet_manager.cc:1918] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:55.275072 8786 log.cc:1196] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:26:55.275687 8786 ts_tablet_manager.cc:1939] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:55.282231 8786 tablet_replica.cc:330] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:55.282606 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 (table default.Table_736993619204407d83bd0619aee8a645 [id=589f397fce314ea1ad0c0e42e4943267]) successfully deleted
I20260812 19:26:55.285014 8786 raft_consensus.cc:2229] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:55.285564 8786 raft_consensus.cc:2258] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.287523 8786 ts_tablet_manager.cc:1905] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:55.306701 8625 ts_tablet_manager.cc:1918] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:55.307358 8625 log.cc:1196] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/2a43b5f9446b4ed4a0349af7d8c16f8f
I20260812 19:26:55.308175 8625 ts_tablet_manager.cc:1939] T 2a43b5f9446b4ed4a0349af7d8c16f8f P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:55.344960 7960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet a1bd8f6905c24ae19c3370246028f7fd
I20260812 19:26:55.347715 8786 ts_tablet_manager.cc:1918] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:55.348095 8786 log.cc:1196] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/756557a37a924bcf9d7c0743beed6a9d
I20260812 19:26:55.349798 7960 catalog_manager.cc:6565] ReplaceTablet: tablet a1bd8f6905c24ae19c3370246028f7fd deleted and replaced by tablet 384506029b4e49639f87f6d7005fa0a9
I20260812 19:26:55.350746 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet a1bd8f6905c24ae19c3370246028f7fd with delete_type TABLET_DATA_DELETED (replaced by tablet 384506029b4e49639f87f6d7005fa0a9) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:55.358354 8933 ts_tablet_manager.cc:1905] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:55.365130 8786 ts_tablet_manager.cc:1939] T 756557a37a924bcf9d7c0743beed6a9d P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:55.376119 8786 tablet_replica.cc:330] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:55.376477 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 756557a37a924bcf9d7c0743beed6a9d (table default.Table_9f6c648486734773bac487f03209f60b [id=c04a06245afc4bc39447bcb6ca5940af]) successfully deleted
I20260812 19:26:55.377452 8636 tablet_bootstrap.cc:700] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent opening tablet: real 0.102s user 0.000s sys 0.003s
I20260812 19:26:55.383891 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 946ac8237fb5475cab84ce69180e13b0 (table default.Table_93219d4aa801471ab3650eb30f289b21 [id=1c3e047dba584132ba65b5c2db357a33]) successfully deleted
I20260812 19:26:55.384156 8786 raft_consensus.cc:2229] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:55.384845 8786 raft_consensus.cc:2258] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.395949 8786 ts_tablet_manager.cc:1905] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:55.400542 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet f313502f35a046188c4b24c10b762c7b (table default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d [id=54b1f58892924c83a98dd0761039f77d]) successfully deleted
W20260812 19:26:55.392079 8446 leader_election.cc:341] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.408397 8636 tablet_bootstrap.cc:654] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.423298 8846 raft_consensus.cc:482] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:55.423846 8846 raft_consensus.cc:504] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.347259 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet a1bd8f6905c24ae19c3370246028f7fd with delete_type TABLET_DATA_DELETED (replaced by tablet 384506029b4e49639f87f6d7005fa0a9) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:55.425392 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 73) took 4071 ms. Trace:
I20260812 19:26:55.425716 8846 leader_election.cc:288] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:55.425688 8625 rpcz_store.cc:276] 0812 19:26:51.354268 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.355430 (+ 1162us) service_pool.cc:227] Handling call
0812 19:26:54.693424 (+3337994us) ts_tablet_manager.cc:1145] Deleting tablet 2a43b5f9446b4ed4a0349af7d8c16f8f
0812 19:26:54.697595 (+ 4171us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:54.894629 (+197034us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.306430 (+411801us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.425338 (+118908us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3226208}
I20260812 19:26:55.397267 8623 tablet_bootstrap.cc:654] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.427874 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:55.399179 7960 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_efbd37ddd76e44dcb7b965fc04ea412b" } new_table_name: "default.Table_b7c8e765cce94561ad357c2d6a61126c" modify_external_catalogs: true
W20260812 19:26:55.429616 8278 leader_election.cc:341] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:55.424786 7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 29) took 1074 ms (client timeout 1000 ms). Trace:
I20260812 19:26:55.426993 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 2a43b5f9446b4ed4a0349af7d8c16f8f (table default.Table_63698336eb614df88eca5031884199fd [id=3e92ad5d601b482aaabc37ffd7e7a9e7]) successfully deleted
I20260812 19:26:55.436038 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet a1bd8f6905c24ae19c3370246028f7fd with delete_type TABLET_DATA_DELETED (replaced by tablet 384506029b4e49639f87f6d7005fa0a9) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:55.437857 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:55.439004 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:55.441772 8786 ts_tablet_manager.cc:1918] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:55.442145 8786 log.cc:1196] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/a1bd8f6905c24ae19c3370246028f7fd
I20260812 19:26:55.443222 8786 ts_tablet_manager.cc:1939] T a1bd8f6905c24ae19c3370246028f7fd P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:55.444670 8977 tablet.cc:1722] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:55.447230 8156 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 108) took 1008 ms. Trace:
I20260812 19:26:55.447649 8156 rpcz_store.cc:276] 0812 19:26:54.438773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.439075 (+ 302us) service_pool.cc:227] Handling call
0812 19:26:54.456118 (+ 17043us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:54.456231 (+ 113us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:54.860088 (+403857us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.446577 (+586489us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:55.447172 (+ 595us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:26:55.404557 8839 raft_consensus.cc:482] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:55.413427 8983 consensus_queue.cc:1035] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:55.453207 8961 tablet.cc:1722] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:55.454713 8627 tablet_bootstrap.cc:492] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:55.455121 8627 ts_tablet_manager.cc:1397] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.245s user 0.010s sys 0.004s
I20260812 19:26:55.458123 8627 raft_consensus.cc:348] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.458825 8627 raft_consensus.cc:374] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.459076 8627 raft_consensus.cc:729] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:26:55.432816 7962 rpcz_store.cc:269] 0812 19:26:54.350015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.367961 (+ 17946us) service_pool.cc:227] Handling call
0812 19:26:55.424712 (+1056751us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":358288,"reported_tablets":9}
I20260812 19:26:55.461221 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]) successfully deleted
I20260812 19:26:55.413849 8958 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33126 (request call id 103) took 1212 ms. Trace:
I20260812 19:26:55.414575 8955 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33126 (request call id 102) took 1320 ms. Trace:
I20260812 19:26:55.474166 8636 tablet_bootstrap.cc:492] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:55.474668 8636 ts_tablet_manager.cc:1397] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.413s user 0.006s sys 0.010s
I20260812 19:26:55.476964 8636 raft_consensus.cc:348] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.478632 8636 raft_consensus.cc:374] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.478940 8636 raft_consensus.cc:729] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:55.479888 8636 consensus_queue.cc:260] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.460389 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 81) took 3755 ms. Trace:
I20260812 19:26:55.474905 8623 tablet_bootstrap.cc:492] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:55.482820 8623 ts_tablet_manager.cc:1397] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.632s user 0.016s sys 0.006s
I20260812 19:26:55.483095 8625 rpcz_store.cc:276] 0812 19:26:51.704673 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.705006 (+ 333us) service_pool.cc:227] Handling call
0812 19:26:55.427521 (+3722515us) ts_tablet_manager.cc:1145] Deleting tablet 017b6bfef5f44da0866917e04e2db072
0812 19:26:55.427559 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.460313 (+ 32754us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3713369}
W20260812 19:26:55.484987 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 017b6bfef5f44da0866917e04e2db072 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 017b6bfef5f44da0866917e04e2db072 already in progress: creating tablet
I20260812 19:26:55.474124 8958 rpcz_store.cc:276] 0812 19:26:54.201878 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.202054 (+ 176us) service_pool.cc:227] Handling call
0812 19:26:55.413783 (+1211729us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:54.203269 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0812 19:26:54.203599 (+ 330us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0812 19:26:54.203630 (+ 31us) alter_schema_op.cc:65] Acquired schema lock
0812 19:26:54.203673 (+ 43us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0812 19:26:54.203777 (+ 104us) alter_schema_op.cc:126] START. Timestamp: 1786562814203678
0812 19:26:54.203798 (+ 21us) op_driver.cc:331] REPLICATION: starting
0812 19:26:54.204333 (+ 535us) log.cc:842] Serialized 173 byte log entry
0812 19:26:54.295793 (+ 91460us) op_driver.cc:444] REPLICATION: finished
0812 19:26:54.545215 (+249422us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0812 19:26:54.557321 (+ 12106us) log.cc:842] Serialized 5 byte log entry
0812 19:26:55.378399 (+821078us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.379964 (+ 1565us) log.cc:842] Serialized 14 byte log entry
0812 19:26:55.413630 (+ 33666us) alter_schema_op.cc:71] Released schema lock
0812 19:26:55.413670 (+ 40us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":249147,"prepare.queue_time_us":401,"prepare.run_cpu_time_us":1457,"prepare.run_wall_time_us":7905,"raft.queue_time_us":348,"raft.run_cpu_time_us":1777,"raft.run_wall_time_us":3008,"replication_time_us":91839,"thread_start_us":299037,"threads_started":1}]]}
I20260812 19:26:55.494431 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 80) took 3790 ms. Trace:
I20260812 19:26:55.494979 8625 rpcz_store.cc:276] 0812 19:26:51.704336 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.732446 (+ 28110us) service_pool.cc:227] Handling call
0812 19:26:55.484153 (+3751707us) ts_tablet_manager.cc:1145] Deleting tablet eec275b2131d4848ae120d8a841a1cae
0812 19:26:55.484202 (+ 49us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.494371 (+ 10169us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3750959}
W20260812 19:26:55.462213 8281 leader_election.cc:341] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.504700 8281 leader_election.cc:302] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:55.505949 8846 raft_consensus.cc:2726] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:55.507042 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 44870.6us
I20260812 19:26:55.459656 8627 consensus_queue.cc:260] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.510892 8627 ts_tablet_manager.cc:1428] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.056s user 0.006s sys 0.000s
I20260812 19:26:55.513895 8627 tablet_bootstrap.cc:492] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:26:55.514892 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet eec275b2131d4848ae120d8a841a1cae because tablet deleting was already in progress. No further retry: Already present: State transition of tablet eec275b2131d4848ae120d8a841a1cae already in progress: creating tablet
W20260812 19:26:55.518271 8993 log.cc:924] Time spent T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.057s user 0.000s sys 0.000s
I20260812 19:26:55.525599 8623 raft_consensus.cc:348] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.526455 8623 raft_consensus.cc:374] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.526765 8623 raft_consensus.cc:729] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:55.530061 8623 consensus_queue.cc:260] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.532486 8846 raft_consensus.cc:482] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:55.533178 8846 raft_consensus.cc:504] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.535068 8636 ts_tablet_manager.cc:1428] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.060s user 0.005s sys 0.000s
I20260812 19:26:55.473505 8839 raft_consensus.cc:504] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.535961 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 87) took 2842 ms. Trace:
I20260812 19:26:55.537318 8846 leader_election.cc:288] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:55.536584 8625 rpcz_store.cc:276] 0812 19:26:52.693108 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.693275 (+ 167us) service_pool.cc:227] Handling call
0812 19:26:55.496195 (+2802920us) ts_tablet_manager.cc:1145] Deleting tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4
0812 19:26:55.496242 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.535881 (+ 39639us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2802327}
I20260812 19:26:55.555087 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "453a403d1c0b4b5c8dcd9b93c7cc9ea4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:55.557130 8636 tablet_bootstrap.cc:492] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:55.558497 8627 tablet_bootstrap.cc:654] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:55.562728 8278 leader_election.cc:341] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.568190 8636 tablet_bootstrap.cc:654] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.487324 8933 ts_tablet_manager.cc:1918] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 19:26:55.575412 8933 log.cc:1196] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/dab1e77a362d483788ac38318df3b58a
I20260812 19:26:55.576836 8933 ts_tablet_manager.cc:1939] T dab1e77a362d483788ac38318df3b58a P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
W20260812 19:26:55.589259 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 149537us
I20260812 19:26:55.474227 8955 rpcz_store.cc:276] 0812 19:26:54.093763 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.093925 (+ 162us) service_pool.cc:227] Handling call
0812 19:26:55.414516 (+1320591us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:54.111193 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0812 19:26:54.111629 (+ 436us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0812 19:26:54.111672 (+ 43us) alter_schema_op.cc:65] Acquired schema lock
0812 19:26:54.111719 (+ 47us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0812 19:26:54.112230 (+ 511us) alter_schema_op.cc:126] START. Timestamp: 1786562814112135
0812 19:26:54.112269 (+ 39us) op_driver.cc:331] REPLICATION: starting
0812 19:26:54.112886 (+ 617us) log.cc:842] Serialized 173 byte log entry
0812 19:26:54.386083 (+273197us) op_driver.cc:444] REPLICATION: finished
0812 19:26:54.604789 (+218706us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0812 19:26:54.645296 (+ 40507us) log.cc:842] Serialized 5 byte log entry
0812 19:26:55.381327 (+736031us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.383039 (+ 1712us) log.cc:842] Serialized 14 byte log entry
0812 19:26:55.414362 (+ 31323us) alter_schema_op.cc:71] Released schema lock
0812 19:26:55.414387 (+ 25us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":218396,"prepare.queue_time_us":16486,"prepare.run_cpu_time_us":6163,"prepare.run_wall_time_us":76345,"raft.queue_time_us":223,"raft.run_cpu_time_us":1934,"raft.run_wall_time_us":2089,"replication_time_us":273665,"spinlock_wait_cycles":13184,"thread_start_us":202836,"threads_started":2,"wal-append.queue_time_us":61410}]]}
I20260812 19:26:55.540234 8152 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 112) took 1022 ms. Trace:
I20260812 19:26:55.593070 8152 rpcz_store.cc:276] 0812 19:26:54.517996 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.518176 (+ 180us) service_pool.cc:227] Handling call
0812 19:26:54.557077 (+ 38901us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:54.557222 (+ 145us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:54.901487 (+344265us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.539402 (+637915us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:55.540153 (+ 751us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:26:55.562661 8108 leader_election.cc:341] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: f313502f35a046188c4b24c10b762c7b
I20260812 19:26:55.563392 8839 leader_election.cc:288] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:55.568087 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "453a403d1c0b4b5c8dcd9b93c7cc9ea4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:55.577952 8107 consensus_peers.cc:487] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:55.605990 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 already in progress: creating tablet
I20260812 19:26:55.608516 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 88) took 2907 ms. Trace:
I20260812 19:26:55.610916 8625 rpcz_store.cc:276] 0812 19:26:52.701441 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.702935 (+ 1494us) service_pool.cc:227] Handling call
0812 19:26:55.607421 (+2904486us) ts_tablet_manager.cc:1145] Deleting tablet 4dc5602ff1c24b6ab561389031d89885
0812 19:26:55.607466 (+ 45us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.608458 (+ 992us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2903836}
W20260812 19:26:55.611857 8107 leader_election.cc:341] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Not found: Tablet not found: f313502f35a046188c4b24c10b762c7b
W20260812 19:26:55.612517 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 4dc5602ff1c24b6ab561389031d89885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4dc5602ff1c24b6ab561389031d89885 already in progress: creating tablet
I20260812 19:26:55.612540 8107 leader_election.cc:302] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:55.614300 8839 raft_consensus.cc:2726] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:55.615010 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 89) took 2913 ms. Trace:
I20260812 19:26:55.616957 8625 rpcz_store.cc:276] 0812 19:26:52.701855 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.703680 (+ 1825us) service_pool.cc:227] Handling call
0812 19:26:55.613406 (+2909726us) ts_tablet_manager.cc:1145] Deleting tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867
0812 19:26:55.613447 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.614956 (+ 1509us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2909017}
W20260812 19:26:55.624444 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 already in progress: creating tablet
I20260812 19:26:55.562062 8623 ts_tablet_manager.cc:1428] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.079s user 0.007s sys 0.001s
I20260812 19:26:55.625983 8623 tablet_bootstrap.cc:492] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:55.631991 7962 master_service.cc:946] ReplaceTablet: received request to replace tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:55.592350 8636 tablet_bootstrap.cc:492] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:55.599807 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet b961a688b260424499bef8e6bf62734f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:48 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:55.627151 8490 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfebac9602f494eb19772589992f888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:55.635393 8636 ts_tablet_manager.cc:1397] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.099s user 0.011s sys 0.011s
W20260812 19:26:55.659971 7945 consensus_peers.cc:487] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 -> Peer 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563): Couldn't send request to peer 1e9a660a0f1e4fc6bc6335b38eece0bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260812 19:26:55.664115 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 90) took 2943 ms. Trace:
I20260812 19:26:55.664460 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 93) took 1334 ms. Trace:
I20260812 19:26:55.664590 8625 rpcz_store.cc:276] 0812 19:26:52.720781 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.720925 (+ 144us) service_pool.cc:227] Handling call
0812 19:26:55.645807 (+2924882us) ts_tablet_manager.cc:1145] Deleting tablet 5f73e97db5954612ab9dfa21bc435efd
0812 19:26:55.663664 (+ 17857us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.664041 (+ 377us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2924287}
I20260812 19:26:55.666505 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 91) took 2908 ms. Trace:
I20260812 19:26:55.666877 8625 rpcz_store.cc:276] 0812 19:26:52.758317 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.758473 (+ 156us) service_pool.cc:227] Handling call
0812 19:26:55.666112 (+2907639us) ts_tablet_manager.cc:1145] Deleting tablet 946ac8237fb5475cab84ce69180e13b0
0812 19:26:55.666184 (+ 72us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.666457 (+ 273us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2907007}
I20260812 19:26:55.664861 8933 rpcz_store.cc:276] 0812 19:26:54.330508 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.330727 (+ 219us) service_pool.cc:227] Handling call
0812 19:26:55.246034 (+915307us) ts_tablet_manager.cc:1145] Deleting tablet dab1e77a362d483788ac38318df3b58a
0812 19:26:55.246081 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.466806 (+220725us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.487029 (+ 20223us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.664371 (+177342us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7644,"tablet-delete.queue_time_us":914331}
I20260812 19:26:55.671543 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_5cdd162632bc4043adb1f98902dc836b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:55.674371 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_6f43770d0ded42fca9530db781825e48"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:55.677327 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]) successfully deleted
W20260812 19:26:55.677884 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6f43770d0ded42fca9530db781825e48 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:55.681044 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_2c80f7680532421eba6c258b2820ae59"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:55.681957 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 92) took 1352 ms. Trace:
W20260812 19:26:55.682679 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_2c80f7680532421eba6c258b2820ae59 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:55.682276 8933 rpcz_store.cc:276] 0812 19:26:54.329309 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.333210 (+ 3901us) service_pool.cc:227] Handling call
0812 19:26:55.678937 (+1345727us) ts_tablet_manager.cc:1145] Deleting tablet 1bd34ec17d8c4609ad979fab951c8a96
0812 19:26:55.679023 (+ 86us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.681886 (+ 2863us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1341778}
W20260812 19:26:55.683595 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 1bd34ec17d8c4609ad979fab951c8a96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bd34ec17d8c4609ad979fab951c8a96 already in progress: creating tablet
I20260812 19:26:55.684988 7953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7" } modify_external_catalogs: true
I20260812 19:26:55.685565 7953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7" } modify_external_catalogs: true
W20260812 19:26:55.688226 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5cdd162632bc4043adb1f98902dc836b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:55.688500 8910 raft_consensus.cc:482] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:26:55.666002 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 5f73e97db5954612ab9dfa21bc435efd because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f73e97db5954612ab9dfa21bc435efd already in progress: creating tablet
I20260812 19:26:55.691563 8910 raft_consensus.cc:504] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.693171 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 95) took 1241 ms. Trace:
I20260812 19:26:55.697450 8910 leader_election.cc:288] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:55.697289 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69fe5774f8dc46308954e9be54bd92b2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:55.699944 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 946ac8237fb5475cab84ce69180e13b0 because the tablet was not found. No further retry: Not found: Tablet not found: 946ac8237fb5475cab84ce69180e13b0
I20260812 19:26:55.700538 8933 rpcz_store.cc:276] 0812 19:26:54.451791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.452751 (+ 960us) service_pool.cc:227] Handling call
0812 19:26:55.687084 (+1234333us) ts_tablet_manager.cc:1145] Deleting tablet dbafc01c482b493a981aed31ce112885
0812 19:26:55.687147 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.693069 (+ 5922us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1205137}
W20260812 19:26:55.700428 8107 leader_election.cc:341] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.700233 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 93) took 2937 ms. Trace:
I20260812 19:26:55.705693 8625 rpcz_store.cc:276] 0812 19:26:52.762735 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:52.765244 (+ 2509us) service_pool.cc:227] Handling call
0812 19:26:55.699774 (+2934530us) ts_tablet_manager.cc:1145] Deleting tablet b961a688b260424499bef8e6bf62734f
0812 19:26:55.699831 (+ 57us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.700162 (+ 331us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2933968}
I20260812 19:26:55.663547 8636 raft_consensus.cc:348] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.709420 8636 raft_consensus.cc:374] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.709770 8636 raft_consensus.cc:729] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
W20260812 19:26:55.709739 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet dbafc01c482b493a981aed31ce112885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbafc01c482b493a981aed31ce112885 already in progress: creating tablet
I20260812 19:26:55.710502 8636 consensus_queue.cc:260] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.711053 8933 tablet_replica.cc:330] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:55.715349 8933 raft_consensus.cc:2229] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:55.717473 8623 tablet_bootstrap.cc:654] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.718540 8933 raft_consensus.cc:2258] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.707741 8625 tablet_replica.cc:330] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:55.722934 8625 raft_consensus.cc:2229] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:55.724363 8625 raft_consensus.cc:2258] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:55.724507 8107 consensus_peers.cc:487] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:55.740543 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet b961a688b260424499bef8e6bf62734f because the tablet was not found. No further retry: Not found: Tablet not found: b961a688b260424499bef8e6bf62734f
I20260812 19:26:55.744683 8933 ts_tablet_manager.cc:1905] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:55.748687 8636 ts_tablet_manager.cc:1428] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.113s user 0.007s sys 0.001s
W20260812 19:26:55.752434 9005 log.cc:924] Time spent T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.152s user 0.000s sys 0.001s
W20260812 19:26:55.754745 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0fd84e685b2b4e819f4b61e442828b13 has no consensus state
I20260812 19:26:55.751765 8625 ts_tablet_manager.cc:1905] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:55.756528 8281 leader_election.cc:341] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.765476 8281 leader_election.cc:302] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:26:55.774979 8108 consensus_peers.cc:487] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dab1e77a362d483788ac38318df3b58a. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:55.777621 8627 tablet_bootstrap.cc:492] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:55.778172 8627 ts_tablet_manager.cc:1397] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.265s user 0.001s sys 0.022s
I20260812 19:26:55.783281 8627 raft_consensus.cc:348] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:55.795018 8108 leader_election.cc:341] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 69fe5774f8dc46308954e9be54bd92b2
I20260812 19:26:55.795811 8108 leader_election.cc:302] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:55.797098 8910 raft_consensus.cc:2726] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:55.801245 8108 consensus_peers.cc:487] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a1bd8f6905c24ae19c3370246028f7fd. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:55.785879 8846 raft_consensus.cc:2726] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:55.816443 8627 raft_consensus.cc:374] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.817936 8627 raft_consensus.cc:729] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:55.819650 8627 consensus_queue.cc:260] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.824350 8623 tablet_bootstrap.cc:492] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:55.824772 8623 ts_tablet_manager.cc:1397] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.199s user 0.016s sys 0.018s
I20260812 19:26:55.827792 8623 raft_consensus.cc:348] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.829697 8623 raft_consensus.cc:374] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.829928 8623 raft_consensus.cc:729] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:55.830473 8623 consensus_queue.cc:260] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.832553 8623 ts_tablet_manager.cc:1428] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20260812 19:26:55.846072 8623 tablet_bootstrap.cc:492] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:55.850003 8625 ts_tablet_manager.cc:1918] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:55.850525 8625 log.cc:1196] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/5bfebac9602f494eb19772589992f888
I20260812 19:26:55.851483 8625 ts_tablet_manager.cc:1939] T 5bfebac9602f494eb19772589992f888 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:55.854085 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 100) took 2055 ms. Trace:
I20260812 19:26:55.854463 8625 rpcz_store.cc:276] 0812 19:26:53.798869 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.798988 (+ 119us) service_pool.cc:227] Handling call
0812 19:26:55.707541 (+1908553us) ts_tablet_manager.cc:1145] Deleting tablet 5bfebac9602f494eb19772589992f888
0812 19:26:55.707597 (+ 56us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.787267 (+ 79670us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.849703 (+ 62436us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.854006 (+ 4303us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1870337}
I20260812 19:26:55.856782 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 5bfebac9602f494eb19772589992f888 (table default.Table_fd31cd728ca24dcdaae0d1ac6542a3ed [id=f53979057a0b4180a028a935227c80bb]) successfully deleted
I20260812 19:26:55.865314 8625 tablet_replica.cc:330] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:55.871948 8623 tablet_bootstrap.cc:654] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.872442 8627 ts_tablet_manager.cc:1428] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.094s user 0.003s sys 0.006s
I20260812 19:26:55.873701 8627 tablet_bootstrap.cc:492] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:55.866454 8625 raft_consensus.cc:2229] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:55.880604 8625 raft_consensus.cc:2258] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.826361 8869 raft_consensus.cc:482] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:55.881951 8869 raft_consensus.cc:504] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:55.886297 8625 ts_tablet_manager.cc:1905] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:55.886691 8869 leader_election.cc:288] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:55.889164 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77445461e7f24c1e80bedb96b2af5daf" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:55.890226 8180 raft_consensus.cc:2454] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:26:55.892494 8446 leader_election.cc:302] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:26:55.893687 8636 tablet_bootstrap.cc:492] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:55.896816 8846 raft_consensus.cc:482] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:55.897866 8846 raft_consensus.cc:504] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.899186 8869 raft_consensus.cc:2781] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:55.899814 8869 raft_consensus.cc:482] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:55.900575 8869 raft_consensus.cc:3037] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:55.902021 8846 leader_election.cc:288] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:26:55.910507 8443 leader_election.cc:341] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 77445461e7f24c1e80bedb96b2af5daf
I20260812 19:26:55.911784 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:55.914309 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:55.916234 8281 leader_election.cc:341] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:55.920820 8278 leader_election.cc:341] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.921212 8278 leader_election.cc:302] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:55.927438 8846 raft_consensus.cc:2726] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:55.932883 8625 ts_tablet_manager.cc:1918] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:55.932634 9009 tablet.cc:1722] T 61fce7b5a9d84718a1ed252f9f5f91d9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:55.933259 8625 log.cc:1196] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/f313502f35a046188c4b24c10b762c7b
I20260812 19:26:55.933907 8625 ts_tablet_manager.cc:1939] T f313502f35a046188c4b24c10b762c7b P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:55.935738 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 99) took 2158 ms. Trace:
I20260812 19:26:55.935760 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]). Expected version 2 got 0
I20260812 19:26:55.938231 8623 tablet_bootstrap.cc:492] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:55.938683 8623 ts_tablet_manager.cc:1397] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.093s user 0.004s sys 0.023s
I20260812 19:26:55.940862 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_f429f2bd365a4d5fa9bd32e3d490473b [id=a7e6cd0f83cc491cb3f68098aab6dbab]). Expected version 2 got 1
I20260812 19:26:55.942170 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 538d05c5883d4575b8eb5d42dfb3c246 (table default.Table_aab7fcc80b1f4c74b682254b2c072364 [id=d8d745230100465d86d0374a29aabd7c]). Expected version 1 got 0
I20260812 19:26:55.942427 8623 raft_consensus.cc:348] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.943065 8623 raft_consensus.cc:374] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:55.943289 8623 raft_consensus.cc:729] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:55.943109 7959 catalog_manager.cc:5495] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:55.943846 8623 consensus_queue.cc:260] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.946295 8623 ts_tablet_manager.cc:1428] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260812 19:26:55.951156 8623 tablet_bootstrap.cc:492] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:55.958257 9017 raft_consensus.cc:482] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:55.959414 9017 raft_consensus.cc:504] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:55.936053 8625 rpcz_store.cc:276] 0812 19:26:53.777513 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:53.798148 (+ 20635us) service_pool.cc:227] Handling call
0812 19:26:55.865028 (+2066880us) ts_tablet_manager.cc:1145] Deleting tablet f313502f35a046188c4b24c10b762c7b
0812 19:26:55.865108 (+ 80us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.912776 (+ 47668us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.932652 (+ 19876us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:55.935675 (+ 3023us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2027441}
I20260812 19:26:55.962785 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 104) took 1684 ms. Trace:
I20260812 19:26:55.963079 8625 rpcz_store.cc:276] 0812 19:26:54.278146 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.278457 (+ 311us) service_pool.cc:227] Handling call
0812 19:26:55.962390 (+1683933us) ts_tablet_manager.cc:1145] Deleting tablet 1bd34ec17d8c4609ad979fab951c8a96
0812 19:26:55.962432 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.962659 (+ 227us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1683052}
I20260812 19:26:55.965188 9017 leader_election.cc:288] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:55.967579 8625 tablet_replica.cc:330] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:55.967669 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eec275b2131d4848ae120d8a841a1cae" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:55.968570 8625 raft_consensus.cc:2229] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:55.969820 8625 raft_consensus.cc:2258] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:55.970014 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eec275b2131d4848ae120d8a841a1cae" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:55.972975 8281 leader_election.cc:341] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.973276 8625 ts_tablet_manager.cc:1905] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:55.973608 8278 leader_election.cc:341] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:55.974254 8278 leader_election.cc:302] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:55.975561 9017 raft_consensus.cc:2726] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:55.980037 8627 tablet_bootstrap.cc:654] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.981424 8623 tablet_bootstrap.cc:654] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.983021 8636 tablet_bootstrap.cc:654] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:55.997207 8623 tablet_bootstrap.cc:492] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:55.997733 8623 ts_tablet_manager.cc:1397] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.047s user 0.011s sys 0.002s
I20260812 19:26:56.000064 8623 raft_consensus.cc:348] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.000823 8623 raft_consensus.cc:374] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.001068 8623 raft_consensus.cc:729] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.001981 8623 consensus_queue.cc:260] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.003907 8623 ts_tablet_manager.cc:1428] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 19:26:56.008293 8625 ts_tablet_manager.cc:1918] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260812 19:26:56.008705 8625 log.cc:1196] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/dab1e77a362d483788ac38318df3b58a
I20260812 19:26:56.009449 8625 ts_tablet_manager.cc:1939] T dab1e77a362d483788ac38318df3b58a P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:56.013967 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 105) took 1728 ms. Trace:
I20260812 19:26:56.014320 8625 rpcz_store.cc:276] 0812 19:26:54.285933 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.286259 (+ 326us) service_pool.cc:227] Handling call
0812 19:26:55.964458 (+1678199us) ts_tablet_manager.cc:1145] Deleting tablet dab1e77a362d483788ac38318df3b58a
0812 19:26:55.964501 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:55.980578 (+ 16077us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:56.008040 (+ 27462us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:56.013906 (+ 5866us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677544}
I20260812 19:26:56.015791 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 107) took 1590 ms. Trace:
I20260812 19:26:56.016081 8625 rpcz_store.cc:276] 0812 19:26:54.438040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.438844 (+ 804us) service_pool.cc:227] Handling call
0812 19:26:56.015474 (+1576630us) ts_tablet_manager.cc:1145] Deleting tablet dbafc01c482b493a981aed31ce112885
0812 19:26:56.015515 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:56.015745 (+ 230us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1564632}
I20260812 19:26:56.020509 8623 tablet_bootstrap.cc:492] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:56.023648 8933 ts_tablet_manager.cc:1918] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:56.024164 8933 log.cc:1196] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/a1bd8f6905c24ae19c3370246028f7fd
I20260812 19:26:56.025102 8933 ts_tablet_manager.cc:1939] T a1bd8f6905c24ae19c3370246028f7fd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:56.025147 8625 tablet_replica.cc:330] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:56.025875 8625 raft_consensus.cc:2229] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:56.026846 8625 raft_consensus.cc:2258] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:56.028786 8625 ts_tablet_manager.cc:1905] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:56.031157 8623 tablet_bootstrap.cc:654] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.033798 8627 tablet_bootstrap.cc:492] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
W20260812 19:26:56.034346 8849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
I20260812 19:26:56.034588 8627 ts_tablet_manager.cc:1397] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.161s user 0.007s sys 0.007s
W20260812 19:26:56.035337 8849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:26:56.037111 8849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260812 19:26:56.052416 8490 tablet_service.cc:1467] Processing CreateTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f (DEFAULT_TABLE table=default.Table_771c0d6e0724423f812f274ab0c28078 [id=0e04666fe6ae47579191d2aebbfdc45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.053434 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f (DEFAULT_TABLE table=default.Table_771c0d6e0724423f812f274ab0c28078 [id=0e04666fe6ae47579191d2aebbfdc45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.053803 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.053853 8933 tablet_replica.cc:330] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:56.054421 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.056886 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b (DEFAULT_TABLE table=default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.057782 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.061167 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b (DEFAULT_TABLE table=default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.061555 8627 raft_consensus.cc:348] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.062245 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.062220 8627 raft_consensus.cc:374] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.062450 8627 raft_consensus.cc:729] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.030812 8869 raft_consensus.cc:504] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.039130 8636 tablet_bootstrap.cc:492] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:56.063335 8636 ts_tablet_manager.cc:1397] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.170s user 0.009s sys 0.004s
I20260812 19:26:56.063040 8627 consensus_queue.cc:260] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.064350 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 544d3d74baa6477da11abbee139ee66f (DEFAULT_TABLE table=default.Table_d861fc3b700e405facd2ca9375bed373 [id=ccafff0e3ab7427fb4842de5c82d648f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.065390 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544d3d74baa6477da11abbee139ee66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.068922 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 544d3d74baa6477da11abbee139ee66f (DEFAULT_TABLE table=default.Table_d861fc3b700e405facd2ca9375bed373 [id=ccafff0e3ab7427fb4842de5c82d648f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.069877 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544d3d74baa6477da11abbee139ee66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.070438 8625 ts_tablet_manager.cc:1918] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:56.070817 8625 log.cc:1196] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/a1bd8f6905c24ae19c3370246028f7fd
I20260812 19:26:56.071491 8625 ts_tablet_manager.cc:1939] T a1bd8f6905c24ae19c3370246028f7fd P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:56.072016 8933 raft_consensus.cc:2229] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:56.072502 8933 pending_rounds.cc:62] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Trying to abort 1 pending ops.
I20260812 19:26:56.072504 8636 raft_consensus.cc:348] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.074080 8636 raft_consensus.cc:374] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.074329 8636 raft_consensus.cc:729] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.072736 8933 pending_rounds.cc:68] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761272773357568 op_type: NO_OP noop_request { }
I20260812 19:26:56.077325 8933 raft_consensus.cc:2866] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:56.080420 8933 raft_consensus.cc:2258] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:56.082490 8623 tablet_bootstrap.cc:492] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:56.082907 8623 ts_tablet_manager.cc:1397] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.063s user 0.009s sys 0.008s
I20260812 19:26:56.085111 8623 raft_consensus.cc:348] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.085750 8623 raft_consensus.cc:374] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.086002 8623 raft_consensus.cc:729] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.086602 8623 consensus_queue.cc:260] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.087177 8846 raft_consensus.cc:482] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.087594 8846 raft_consensus.cc:504] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.089634 8623 ts_tablet_manager.cc:1428] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 19:26:56.092234 8846 leader_election.cc:288] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:56.093042 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc5602ff1c24b6ab561389031d89885" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:56.096777 8933 ts_tablet_manager.cc:1905] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:56.087047 8627 ts_tablet_manager.cc:1428] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.052s user 0.004s sys 0.002s
I20260812 19:26:56.098091 8627 tablet_bootstrap.cc:492] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:56.100961 8623 tablet_bootstrap.cc:492] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:26:56.099732 8281 leader_election.cc:341] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.104620 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc5602ff1c24b6ab561389031d89885" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:56.106030 8623 tablet_bootstrap.cc:654] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:56.111689 8278 leader_election.cc:341] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.112072 8278 leader_election.cc:302] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:55.944661 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:56.114041 7959 catalog_manager.cc:5495] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
W20260812 19:26:56.075848 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 204073us
I20260812 19:26:56.121901 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b (DEFAULT_TABLE table=default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.122116 8152 tablet_service.cc:1467] Processing CreateTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f (DEFAULT_TABLE table=default.Table_771c0d6e0724423f812f274ab0c28078 [id=0e04666fe6ae47579191d2aebbfdc45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.122984 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.123597 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 544d3d74baa6477da11abbee139ee66f (DEFAULT_TABLE table=default.Table_d861fc3b700e405facd2ca9375bed373 [id=ccafff0e3ab7427fb4842de5c82d648f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.124480 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 544d3d74baa6477da11abbee139ee66f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.124485 8627 tablet_bootstrap.cc:654] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.128841 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.119951 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet f313502f35a046188c4b24c10b762c7b (table default.Table_3a3b2bbe58e54df9b003fd1e7b9fd32d [id=54b1f58892924c83a98dd0761039f77d]) successfully deleted
W20260812 19:26:56.133638 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 1bd34ec17d8c4609ad979fab951c8a96 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 1bd34ec17d8c4609ad979fab951c8a96 already in progress: creating tablet
I20260812 19:26:56.133785 8623 tablet_bootstrap.cc:492] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:56.134177 8623 ts_tablet_manager.cc:1397] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.033s user 0.006s sys 0.005s
I20260812 19:26:56.134706 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet dab1e77a362d483788ac38318df3b58a (table default.Table_94076c31f10744b49ed2803dca34a8de [id=01ac43559ad945dd9d295920a14479ef]) successfully deleted
W20260812 19:26:56.135478 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet dbafc01c482b493a981aed31ce112885 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet dbafc01c482b493a981aed31ce112885 already in progress: creating tablet
I20260812 19:26:56.080862 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]) successfully deleted
W20260812 19:26:56.136525 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 55853.5us
I20260812 19:26:56.136394 8623 raft_consensus.cc:348] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.137032 8623 raft_consensus.cc:374] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.137254 8623 raft_consensus.cc:729] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.138164 8846 raft_consensus.cc:2726] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.138016 8623 consensus_queue.cc:260] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.139863 8623 ts_tablet_manager.cc:1428] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 19:26:56.140671 8623 tablet_bootstrap.cc:492] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:56.136132 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet a1bd8f6905c24ae19c3370246028f7fd (table default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]) successfully deleted
I20260812 19:26:56.164506 8623 tablet_bootstrap.cc:654] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.074899 8636 consensus_queue.cc:260] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.178498 8333 tablet_service.cc:1467] Processing CreateTablet for tablet f7c9e6328b70417cbeecf31f318f9b61 (DEFAULT_TABLE table=default.Table_8d0e87a9ef4c4bdab9558d30c7597948 [id=58476a06329749f58df3183114bfd735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.179255 8156 tablet_service.cc:1467] Processing CreateTablet for tablet f7c9e6328b70417cbeecf31f318f9b61 (DEFAULT_TABLE table=default.Table_8d0e87a9ef4c4bdab9558d30c7597948 [id=58476a06329749f58df3183114bfd735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.179503 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7c9e6328b70417cbeecf31f318f9b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.180209 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7c9e6328b70417cbeecf31f318f9b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.206910 8488 tablet_service.cc:1467] Processing CreateTablet for tablet f7c9e6328b70417cbeecf31f318f9b61 (DEFAULT_TABLE table=default.Table_8d0e87a9ef4c4bdab9558d30c7597948 [id=58476a06329749f58df3183114bfd735]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.210152 8910 raft_consensus.cc:482] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.210606 8910 raft_consensus.cc:504] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.212440 8910 leader_election.cc:288] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:56.214710 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:56.215699 8353 raft_consensus.cc:2379] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:26:56.221864 8156 tablet_service.cc:1467] Processing CreateTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc (DEFAULT_TABLE table=default.Table_a144bda50c444fd987ca9dbe9d6458b2 [id=98ce767a90c14e65873ae81aad05ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.223148 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df369d3c4e004c29ac65c5ecf7f8c4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.224691 8327 tablet_service.cc:1467] Processing CreateTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc (DEFAULT_TABLE table=default.Table_a144bda50c444fd987ca9dbe9d6458b2 [id=98ce767a90c14e65873ae81aad05ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.234181 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df369d3c4e004c29ac65c5ecf7f8c4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.233603 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b00a037a2567470497e1a751754df345" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:56.234192 8494 tablet_service.cc:1467] Processing CreateTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc (DEFAULT_TABLE table=default.Table_a144bda50c444fd987ca9dbe9d6458b2 [id=98ce767a90c14e65873ae81aad05ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.235266 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df369d3c4e004c29ac65c5ecf7f8c4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.236910 8107 leader_election.cc:302] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:56.237669 8910 raft_consensus.cc:3037] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.239320 8490 tablet_service.cc:1467] Processing CreateTablet for tablet a06d3ff29cc14599bce1531a7b63f072 (DEFAULT_TABLE table=default.Table_72d530bd566d4fa889dd5304f5700a9f [id=8a03ad9f190045adb9f8a0c32c53ab7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.245292 8910 raft_consensus.cc:2726] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.263334 8154 tablet_service.cc:1467] Processing CreateTablet for tablet a06d3ff29cc14599bce1531a7b63f072 (DEFAULT_TABLE table=default.Table_72d530bd566d4fa889dd5304f5700a9f [id=8a03ad9f190045adb9f8a0c32c53ab7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.264549 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06d3ff29cc14599bce1531a7b63f072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.265415 8627 tablet_bootstrap.cc:492] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:56.265841 8627 ts_tablet_manager.cc:1397] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.168s user 0.006s sys 0.005s
I20260812 19:26:56.266827 8327 tablet_service.cc:1467] Processing CreateTablet for tablet a06d3ff29cc14599bce1531a7b63f072 (DEFAULT_TABLE table=default.Table_72d530bd566d4fa889dd5304f5700a9f [id=8a03ad9f190045adb9f8a0c32c53ab7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.268203 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06d3ff29cc14599bce1531a7b63f072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.268560 8627 raft_consensus.cc:348] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.269275 8627 raft_consensus.cc:374] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.269527 8627 raft_consensus.cc:729] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.270219 8627 consensus_queue.cc:260] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.289409 7962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:26:56.290822 7962 catalog_manager.cc:6565] ReplaceTablet: tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 deleted and replaced by tablet f57f252b520945328fdaaa9adef593a1
I20260812 19:26:56.241650 9033 raft_consensus.cc:482] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.292045 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:56.294013 9033 raft_consensus.cc:504] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.295368 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:56.228876 8443 leader_election.cc:341] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 77445461e7f24c1e80bedb96b2af5daf
W20260812 19:26:56.298959 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 already in progress: creating tablet
W20260812 19:26:56.299244 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 91376.2us
I20260812 19:26:56.255553 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7c9e6328b70417cbeecf31f318f9b61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.302444 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77445461e7f24c1e80bedb96b2af5daf" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:56.303037 8180 raft_consensus.cc:3037] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.303647 9029 consensus_queue.cc:1035] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:56.305124 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 5717f521074d49c6baec431f0d739c91 (DEFAULT_TABLE table=default.Table_61a721fd804b43e280c455210e7cabd8 [id=74c19f2de82344a69c7314ac3012fb9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.306341 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5717f521074d49c6baec431f0d739c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.307539 8869 leader_election.cc:288] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:56.311146 8180 raft_consensus.cc:2454] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:26:56.312350 8446 leader_election.cc:302] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:56.313448 8869 raft_consensus.cc:2781] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.314323 8869 raft_consensus.cc:686] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:26:56.315590 8869 consensus_queue.cc:237] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.292652 8636 ts_tablet_manager.cc:1428] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.229s user 0.007s sys 0.002s
I20260812 19:26:56.300400 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 5717f521074d49c6baec431f0d739c91 (DEFAULT_TABLE table=default.Table_61a721fd804b43e280c455210e7cabd8 [id=74c19f2de82344a69c7314ac3012fb9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.321748 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5717f521074d49c6baec431f0d739c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.322225 8623 tablet_bootstrap.cc:492] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:56.323117 8636 tablet_bootstrap.cc:492] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:56.324013 8623 ts_tablet_manager.cc:1397] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.183s user 0.015s sys 0.028s
I20260812 19:26:56.326844 8623 raft_consensus.cc:348] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.327785 8623 raft_consensus.cc:374] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.330523 8910 raft_consensus.cc:482] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.330966 8910 raft_consensus.cc:504] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.328047 8623 raft_consensus.cc:729] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.332911 8910 leader_election.cc:288] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:56.333135 8623 consensus_queue.cc:260] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.334417 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 5717f521074d49c6baec431f0d739c91 (DEFAULT_TABLE table=default.Table_61a721fd804b43e280c455210e7cabd8 [id=74c19f2de82344a69c7314ac3012fb9f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.335425 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5717f521074d49c6baec431f0d739c91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.335491 8623 ts_tablet_manager.cc:1428] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260812 19:26:56.336311 8623 tablet_bootstrap.cc:492] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:56.340655 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a06d3ff29cc14599bce1531a7b63f072. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.343086 8157 tablet_service.cc:1467] Processing CreateTablet for tablet c6075b2e46524829962d2b84353013b2 (DEFAULT_TABLE table=default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.344986 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6075b2e46524829962d2b84353013b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.350504 8330 tablet_service.cc:1467] Processing CreateTablet for tablet c6075b2e46524829962d2b84353013b2 (DEFAULT_TABLE table=default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.351838 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6075b2e46524829962d2b84353013b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.353101 8623 tablet_bootstrap.cc:654] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.355727 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:56.357348 8107 leader_election.cc:341] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.363323 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:56.364147 8353 raft_consensus.cc:2454] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:56.365345 8108 leader_election.cc:302] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:56.366151 8910 raft_consensus.cc:2781] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.366487 8910 raft_consensus.cc:482] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.366786 8910 raft_consensus.cc:3037] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:56.369138 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 already in progress: creating tablet
I20260812 19:26:56.374368 8910 raft_consensus.cc:504] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:56.375963 8849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260812 19:26:56.377244 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:26:56.377451 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 65218.9us
W20260812 19:26:56.378681 8107 leader_election.cc:341] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.379014 8492 tablet_service.cc:1467] Processing CreateTablet for tablet c6075b2e46524829962d2b84353013b2 (DEFAULT_TABLE table=default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.380018 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6075b2e46524829962d2b84353013b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.382476 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 04d56a12f8964d4a9ccbc5f870b89713 (DEFAULT_TABLE table=default.Table_e5f2201cb9bd40ed8267caf59450abca [id=126edf03d2a940f4a97d0478129fb526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.383241 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 04d56a12f8964d4a9ccbc5f870b89713 (DEFAULT_TABLE table=default.Table_e5f2201cb9bd40ed8267caf59450abca [id=126edf03d2a940f4a97d0478129fb526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.383653 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04d56a12f8964d4a9ccbc5f870b89713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.384310 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04d56a12f8964d4a9ccbc5f870b89713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.386788 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd84e685b2b4e819f4b61e442828b13 (DEFAULT_TABLE table=default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.387926 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd84e685b2b4e819f4b61e442828b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.393193 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:56.395352 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:56.396018 8354 raft_consensus.cc:3037] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.396957 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 04d56a12f8964d4a9ccbc5f870b89713 (DEFAULT_TABLE table=default.Table_e5f2201cb9bd40ed8267caf59450abca [id=126edf03d2a940f4a97d0478129fb526]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.397946 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 04d56a12f8964d4a9ccbc5f870b89713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.400236 8623 tablet_bootstrap.cc:492] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:56.400658 8623 ts_tablet_manager.cc:1397] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.065s user 0.011s sys 0.000s
I20260812 19:26:56.401546 9033 leader_election.cc:288] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:56.407925 8933 ts_tablet_manager.cc:1918] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:56.420542 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd84e685b2b4e819f4b61e442828b13 (DEFAULT_TABLE table=default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.421869 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd84e685b2b4e819f4b61e442828b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.401814 8910 leader_election.cc:288] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:56.439211 8354 raft_consensus.cc:2454] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:56.439189 8487 tablet_service.cc:1467] Processing CreateTablet for tablet ed3743a7dde744668cbe91759a499805 (DEFAULT_TABLE table=default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.403151 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:56.420542 8155 tablet_service.cc:1467] Processing CreateTablet for tablet ed3743a7dde744668cbe91759a499805 (DEFAULT_TABLE table=default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.443305 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3743a7dde744668cbe91759a499805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.405795 8623 raft_consensus.cc:348] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.444231 8325 tablet_service.cc:1467] Processing CreateTablet for tablet ed3743a7dde744668cbe91759a499805 (DEFAULT_TABLE table=default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.444957 8623 raft_consensus.cc:374] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.445240 8623 raft_consensus.cc:729] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.446084 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3743a7dde744668cbe91759a499805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.447497 8627 ts_tablet_manager.cc:1428] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.181s user 0.006s sys 0.000s
I20260812 19:26:56.449641 8487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed3743a7dde744668cbe91759a499805. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.454597 7962 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_aab7fcc80b1f4c74b682254b2c072364" } new_table_name: "default.Table_aa5a653ce4b2458d9075328b363afb4b" modify_external_catalogs: true
I20260812 19:26:56.455699 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 7764a1ae009142b29d5fb574dca45e21 (DEFAULT_TABLE table=default.Table_4f6e1ed970454d05afe6de4cbae88fd6 [id=631e82b9e6c445fc92aa599ee0aa44e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.461112 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7764a1ae009142b29d5fb574dca45e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.468523 8332 tablet_service.cc:1467] Processing CreateTablet for tablet 7764a1ae009142b29d5fb574dca45e21 (DEFAULT_TABLE table=default.Table_4f6e1ed970454d05afe6de4cbae88fd6 [id=631e82b9e6c445fc92aa599ee0aa44e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.470463 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7764a1ae009142b29d5fb574dca45e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.491616 7953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 3740799e07f94fe981d395ef8c3d7973
I20260812 19:26:56.491516 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 0fd84e685b2b4e819f4b61e442828b13 (DEFAULT_TABLE table=default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.492935 9033 raft_consensus.cc:482] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.494531 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0fd84e685b2b4e819f4b61e442828b13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.496058 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet 3740799e07f94fe981d395ef8c3d7973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:55 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:56.493554 9033 raft_consensus.cc:504] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.498215 8623 consensus_queue.cc:260] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:26:56.498878 8849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:26:56.499336 8849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
I20260812 19:26:56.499315 7953 master_service.cc:946] ReplaceTablet: received request to replace tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 from {username='slave'} at 127.0.0.1:46888
W20260812 19:26:56.508215 8849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:26:56.514087 8623 ts_tablet_manager.cc:1428] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.113s user 0.007s sys 0.000s
I20260812 19:26:56.515314 8623 tablet_bootstrap.cc:492] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:56.548913 8627 tablet_bootstrap.cc:492] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:56.560668 9043 raft_consensus.cc:482] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.567932 8108 leader_election.cc:302] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:56.566860 9043 raft_consensus.cc:504] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.582048 9043 leader_election.cc:288] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:56.600116 9049 raft_consensus.cc:2781] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:56.601002 9049 raft_consensus.cc:686] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:56.597404 9043 raft_consensus.cc:482] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.606371 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:26:56.605314 9043 raft_consensus.cc:504] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.607975 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:56.610541 9043 leader_election.cc:288] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:56.602409 9049 consensus_queue.cc:237] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:56.630600 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 62754.1us
I20260812 19:26:56.634928 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "68583d63475a495ca97f3221825622e2" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:56.627568 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_c0342c9c603b4c74983e00d14709ee8b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:56.642441 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_c0342c9c603b4c74983e00d14709ee8b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:56.643111 8446 leader_election.cc:302] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:56.644143 8623 tablet_bootstrap.cc:654] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.646320 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_81a4aee1bd344393bbf0378d7796280d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:56.668411 8849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33593
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:33521,127.7.144.253:41563,127.7.144.252:46815
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.253:41563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.144.253
--webserver_port=39161
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:26:56.670058 8849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:26:56.623278 7957 catalog_manager.cc:5495] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:56.677560 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:26:56.679352 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]). Expected version 2 got 0
I20260812 19:26:56.672228 8849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 19:26:56.687314 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 7764a1ae009142b29d5fb574dca45e21 (DEFAULT_TABLE table=default.Table_4f6e1ed970454d05afe6de4cbae88fd6 [id=631e82b9e6c445fc92aa599ee0aa44e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:56.688721 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 3740799e07f94fe981d395ef8c3d7973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:55 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:56.652331 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_81a4aee1bd344393bbf0378d7796280d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:56.702173 8910 raft_consensus.cc:482] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.702875 8910 raft_consensus.cc:504] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:26:56.703408 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 60372us
I20260812 19:26:56.705758 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7764a1ae009142b29d5fb574dca45e21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:56.706058 8910 leader_election.cc:288] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:56.721599 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 3740799e07f94fe981d395ef8c3d7973 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3740799e07f94fe981d395ef8c3d7973 already in progress: creating tablet
I20260812 19:26:56.729597 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 3740799e07f94fe981d395ef8c3d7973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:55 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:56.730695 9030 consensus_queue.cc:1035] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260812 19:26:56.736672 7945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111) [suppressed 7 similar messages]
W20260812 19:26:56.744957 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 3740799e07f94fe981d395ef8c3d7973 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3740799e07f94fe981d395ef8c3d7973 already in progress: creating tablet
I20260812 19:26:56.756604 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d84b58b9c9354801afc338f0751ada49"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:56.758198 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d84b58b9c9354801afc338f0751ada49 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:56.758068 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:56.758679 8354 raft_consensus.cc:2454] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:56.760948 8846 raft_consensus.cc:482] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.761346 8846 raft_consensus.cc:504] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.763276 8846 leader_election.cc:288] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:56.692581 8933 log.cc:1196] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/decf138a91394c939f686ff127ca7922
I20260812 19:26:56.783190 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f73e97db5954612ab9dfa21bc435efd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:56.784058 8517 raft_consensus.cc:2454] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:56.784710 8636 tablet_bootstrap.cc:654] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.721534 8869 raft_consensus.cc:2726] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:56.795809 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "017b6bfef5f44da0866917e04e2db072" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:56.798905 7952 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 155) took 1139 ms. Trace:
I20260812 19:26:56.805397 8511 raft_consensus.cc:3037] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.799561 7952 rpcz_store.cc:276] 0812 19:26:55.659747 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.487616 (+827869us) service_pool.cc:227] Handling call
0812 19:26:56.645061 (+157445us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf156 00007f05ee9ec034 00007f05ee9ebfc2 00007f05ee9ebef1 00007f05ee9ebe6c 00007f05ee9eb122 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:56.708939 (+ 63878us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:26:56.713988 (+ 5049us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:26:56.797057 (+ 83069us) catalog_manager.cc:2181] Wrote table and tablets to system table
0812 19:26:56.798192 (+ 1135us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0812 19:26:56.798805 (+ 613us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:56.776509 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:56.776989 (+ 480us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:56.777024 (+ 35us) write_op.cc:435] Acquired schema lock
0812 19:26:56.777042 (+ 18us) tablet.cc:660] Decoding operations
0812 19:26:56.777443 (+ 401us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:56.777484 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:56.777506 (+ 22us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:56.777683 (+ 177us) tablet.cc:699] Row locks acquired
0812 19:26:56.777694 (+ 11us) write_op.cc:260] PREPARE: finished
0812 19:26:56.777802 (+ 108us) write_op.cc:270] Start()
0812 19:26:56.777892 (+ 90us) write_op.cc:276] Timestamp: P: 1786562816777762 usec, L: 0
0812 19:26:56.777907 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:26:56.778389 (+ 482us) log.cc:842] Serialized 433 byte log entry
0812 19:26:56.791713 (+ 13324us) op_driver.cc:444] REPLICATION: finished
0812 19:26:56.793118 (+ 1405us) write_op.cc:301] APPLY: starting
0812 19:26:56.793261 (+ 143us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:56.793500 (+ 239us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:56.793766 (+ 266us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:56.794655 (+ 889us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:56.794963 (+ 308us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 19:26:56.795081 (+ 118us) write_op.cc:312] APPLY: finished
0812 19:26:56.795536 (+ 455us) log.cc:842] Serialized 29 byte log entry
0812 19:26:56.796521 (+ 985us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:56.796655 (+ 134us) write_op.cc:454] Released schema lock
0812 19:26:56.796719 (+ 64us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":353043712,"child_traces":[["op",{"apply.queue_time_us":1067,"num_ops":2,"prepare.queue_time_us":60794,"prepare.run_cpu_time_us":2184,"prepare.run_wall_time_us":2186,"raft.queue_time_us":889,"raft.run_cpu_time_us":892,"raft.run_wall_time_us":892,"replication_time_us":13681}]]}
W20260812 19:26:56.809265 8108 leader_election.cc:341] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 5f73e97db5954612ab9dfa21bc435efd
W20260812 19:26:56.810649 8108 leader_election.cc:341] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 017b6bfef5f44da0866917e04e2db072
I20260812 19:26:56.812013 9033 leader_election.cc:288] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:56.811736 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_309d353d589c44c5af752d0b6d404dbd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:56.813215 8108 leader_election.cc:302] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:56.814476 9049 raft_consensus.cc:2781] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.815040 9049 raft_consensus.cc:482] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.815430 9049 raft_consensus.cc:3037] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:56.817517 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_309d353d589c44c5af752d0b6d404dbd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:56.800225 8933 ts_tablet_manager.cc:1939] T decf138a91394c939f686ff127ca7922 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
W20260812 19:26:56.844650 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 0fd84e685b2b4e819f4b61e442828b13 consensus state has no leader
I20260812 19:26:56.848446 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb55b45c8db944b18d1fcc0ea92dbebd" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:56.849160 8180 raft_consensus.cc:2454] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:26:56.849766 8623 tablet_bootstrap.cc:492] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:56.850250 8623 ts_tablet_manager.cc:1397] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.335s user 0.011s sys 0.012s
I20260812 19:26:56.851893 8446 leader_election.cc:302] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:26:56.852557 8623 raft_consensus.cc:348] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.853276 8623 raft_consensus.cc:374] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.853547 8623 raft_consensus.cc:729] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.853581 8869 raft_consensus.cc:2781] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.853895 8869 raft_consensus.cc:482] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.854185 8869 raft_consensus.cc:3037] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.854266 8623 consensus_queue.cc:260] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.854596 9049 raft_consensus.cc:504] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.869947 9049 leader_election.cc:288] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:56.878332 8107 leader_election.cc:302] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:56.880692 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:56.893195 8623 ts_tablet_manager.cc:1428] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.043s user 0.006s sys 0.001s
I20260812 19:26:56.894486 8623 tablet_bootstrap.cc:492] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:56.911116 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 102) took 1473 ms. Trace:
I20260812 19:26:56.912225 8933 rpcz_store.cc:276] 0812 19:26:55.437735 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:55.438837 (+ 1102us) service_pool.cc:227] Handling call
0812 19:26:56.053680 (+614843us) ts_tablet_manager.cc:1145] Deleting tablet decf138a91394c939f686ff127ca7922
0812 19:26:56.053724 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:56.131187 (+ 77463us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:56.407670 (+276483us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:56.911008 (+503338us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":614229}
I20260812 19:26:56.921458 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:56.922360 8356 raft_consensus.cc:3037] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.923161 8910 raft_consensus.cc:2781] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:56.923676 8910 raft_consensus.cc:482] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:56.924173 8910 raft_consensus.cc:3037] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:56.926151 8623 tablet_bootstrap.cc:654] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:56.927912 8627 tablet_bootstrap.cc:700] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7: Time spent opening tablet: real 0.106s user 0.000s sys 0.000s
I20260812 19:26:56.928737 8627 tablet_bootstrap.cc:654] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:56.932700 8107 leader_election.cc:341] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.933193 8107 leader_election.cc:302] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:56.935910 9046 raft_consensus.cc:2726] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:56.937729 9063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:26:56.940868 8107 leader_election.cc:341] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.952025 9046 raft_consensus.cc:482] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:56.952548 9046 raft_consensus.cc:504] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:56.954653 9046 leader_election.cc:288] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:56.965443 8623 tablet_bootstrap.cc:492] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:56.966581 8623 ts_tablet_manager.cc:1397] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.072s user 0.010s sys 0.003s
I20260812 19:26:56.970616 8623 raft_consensus.cc:348] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.978864 8623 raft_consensus.cc:374] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:56.979837 8623 raft_consensus.cc:729] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:56.984802 8623 consensus_queue.cc:260] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:56.984961 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:56.934870 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:56.944316 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:26:56.989965 8278 leader_election.cc:341] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:56.991207 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "756557a37a924bcf9d7c0743beed6a9d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:57.007493 8108 leader_election.cc:341] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 756557a37a924bcf9d7c0743beed6a9d
I20260812 19:26:57.035678 8627 tablet_bootstrap.cc:492] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:57.035650 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:57.036327 8627 ts_tablet_manager.cc:1397] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.488s user 0.007s sys 0.013s
I20260812 19:26:57.037400 7954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 650cd08798724b6cb5f7026cd0631b65
I20260812 19:26:57.039321 7954 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 146) took 2332 ms. Trace:
I20260812 19:26:57.040246 8627 raft_consensus.cc:348] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.041083 8627 raft_consensus.cc:374] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:57.041337 8627 raft_consensus.cc:729] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:57.041386 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 650cd08798724b6cb5f7026cd0631b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:54 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:57.042250 9037 tablet_replica.cc:330] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:26:57.027984 8281 leader_election.cc:341] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.043068 9037 raft_consensus.cc:2229] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:57.043401 8281 leader_election.cc:302] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:57.044032 9037 raft_consensus.cc:2258] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:57.045331 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:26:57.045439 9055 raft_consensus.cc:2726] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:57.046049 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:57.046423 9037 ts_tablet_manager.cc:1905] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:57.046952 7955 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:26:57.044785 8910 raft_consensus.cc:504] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.039613 7954 rpcz_store.cc:276] 0812 19:26:54.734651 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.736313 (+ 1662us) service_pool.cc:227] Handling call
0812 19:26:54.783550 (+ 47237us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf466 00007f05ee9f0b34 00007f05ee9f0ac2 00007f05ee9f09f1 00007f05ee9f096c 00007f05ee9efc22 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:54.974537 (+190987us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:54.975205 (+ 668us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:26:54.975383 (+ 178us) catalog_manager.cc:2761] Locking tablets
0812 19:26:54.976017 (+ 634us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:26:55.334903 (+358886us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:26:55.335200 (+ 297us) catalog_manager.cc:2809] Committing in-memory state
0812 19:26:57.036590 (+1701390us) catalog_manager.cc:2813] Aborting table tasks
0812 19:26:57.039223 (+ 2633us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:55.177443 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:55.177874 (+ 431us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:55.177901 (+ 27us) write_op.cc:435] Acquired schema lock
0812 19:26:55.177925 (+ 24us) tablet.cc:660] Decoding operations
0812 19:26:55.178261 (+ 336us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:55.178296 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:55.178316 (+ 20us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:55.178824 (+ 508us) tablet.cc:699] Row locks acquired
0812 19:26:55.178848 (+ 24us) write_op.cc:260] PREPARE: finished
0812 19:26:55.178975 (+ 127us) write_op.cc:270] Start()
0812 19:26:55.179072 (+ 97us) write_op.cc:276] Timestamp: P: 1786562815178917 usec, L: 0
0812 19:26:55.179089 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:26:55.179710 (+ 621us) log.cc:842] Serialized 771 byte log entry
0812 19:26:55.307209 (+127499us) op_driver.cc:444] REPLICATION: finished
0812 19:26:55.315469 (+ 8260us) write_op.cc:301] APPLY: starting
0812 19:26:55.315594 (+ 125us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:55.315858 (+ 264us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:55.316027 (+ 169us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:55.316552 (+ 525us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:55.316905 (+ 353us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:55.317038 (+ 133us) write_op.cc:312] APPLY: finished
0812 19:26:55.317454 (+ 416us) log.cc:842] Serialized 29 byte log entry
0812 19:26:55.334430 (+ 16976us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:55.334549 (+ 119us) write_op.cc:454] Released schema lock
0812 19:26:55.334610 (+ 61us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:55.334949 (+ 339us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:55.335029 (+ 80us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":105433344,"child_traces":[["op",{"apply.queue_time_us":7994,"apply.run_cpu_time_us":3197,"apply.run_wall_time_us":19849,"num_ops":2,"prepare.queue_time_us":93477,"prepare.run_cpu_time_us":2509,"prepare.run_wall_time_us":2508,"replication_time_us":127808}]]}
I20260812 19:26:57.054471 7960 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 148) took 1671 ms. Trace:
I20260812 19:26:57.055378 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 650cd08798724b6cb5f7026cd0631b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:54 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.056176 8625 tablet_replica.cc:330] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:57.056888 8625 raft_consensus.cc:2229] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:57.057464 8625 raft_consensus.cc:2258] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:57.059266 8625 ts_tablet_manager.cc:1905] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:57.054868 7960 rpcz_store.cc:276] 0812 19:26:55.382044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:55.382152 (+ 108us) service_pool.cc:227] Handling call
0812 19:26:55.399059 (+ 16907us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf7d6 00007f05ee9f5634 00007f05ee9f55c2 00007f05ee9f54f1 00007f05ee9f546c 00007f05ee9f4722 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:55.428554 (+ 29495us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:55.429657 (+ 1103us) catalog_manager.cc:3616] Apply alter schema
0812 19:26:55.430211 (+ 554us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:26:55.430420 (+ 209us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:26:55.451931 (+ 21511us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:26:57.053746 (+1601815us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:55.431599 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:55.431934 (+ 335us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:55.431957 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:26:55.431970 (+ 13us) tablet.cc:660] Decoding operations
0812 19:26:55.432215 (+ 245us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:55.432276 (+ 61us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:55.432301 (+ 25us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:55.432442 (+ 141us) tablet.cc:699] Row locks acquired
0812 19:26:55.432455 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:55.432560 (+ 105us) write_op.cc:270] Start()
0812 19:26:55.432643 (+ 83us) write_op.cc:276] Timestamp: P: 1786562815432492 usec, L: 0
0812 19:26:55.432660 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:26:55.433157 (+ 497us) log.cc:842] Serialized 405 byte log entry
0812 19:26:55.443887 (+ 10730us) op_driver.cc:444] REPLICATION: finished
0812 19:26:55.445010 (+ 1123us) write_op.cc:301] APPLY: starting
0812 19:26:55.445061 (+ 51us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:55.445158 (+ 97us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:55.445250 (+ 92us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:55.445401 (+ 151us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:55.446524 (+ 1123us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:55.446573 (+ 49us) write_op.cc:312] APPLY: finished
0812 19:26:55.446757 (+ 184us) log.cc:842] Serialized 23 byte log entry
0812 19:26:55.447355 (+ 598us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:55.447425 (+ 70us) write_op.cc:454] Released schema lock
0812 19:26:55.447458 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:55.447646 (+ 188us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:55.447668 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":35901824,"child_traces":[["op",{"apply.queue_time_us":947,"apply.run_cpu_time_us":1417,"apply.run_wall_time_us":2823,"num_ops":1,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":1811,"prepare.run_wall_time_us":1811,"raft.queue_time_us":991,"raft.run_cpu_time_us":632,"raft.run_wall_time_us":633,"replication_time_us":11149}]]}
I20260812 19:26:57.061252 7962 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 154) took 1402 ms. Trace:
I20260812 19:26:57.062952 8627 consensus_queue.cc:260] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.061556 7962 rpcz_store.cc:276] 0812 19:26:55.659266 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.291564 (+632298us) service_pool.cc:227] Handling call
0812 19:26:56.454491 (+162927us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf7d6 00007f05ee9f5634 00007f05ee9f55c2 00007f05ee9f54f1 00007f05ee9f546c 00007f05ee9f4722 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:56.455783 (+ 1292us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:56.464731 (+ 8948us) catalog_manager.cc:3616] Apply alter schema
0812 19:26:56.465559 (+ 828us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:26:56.465880 (+ 321us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:26:56.666398 (+200518us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:26:57.061187 (+394789us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:56.469628 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:56.469975 (+ 347us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:56.469998 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:26:56.470010 (+ 12us) tablet.cc:660] Decoding operations
0812 19:26:56.470294 (+ 284us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:56.470331 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:56.470353 (+ 22us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:56.470549 (+ 196us) tablet.cc:699] Row locks acquired
0812 19:26:56.470562 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:56.470686 (+ 124us) write_op.cc:270] Start()
0812 19:26:56.470768 (+ 82us) write_op.cc:276] Timestamp: P: 1786562816470554 usec, L: 0
0812 19:26:56.470784 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:26:56.471298 (+ 514us) log.cc:842] Serialized 405 byte log entry
0812 19:26:56.660990 (+189692us) op_driver.cc:444] REPLICATION: finished
0812 19:26:56.661487 (+ 497us) write_op.cc:301] APPLY: starting
0812 19:26:56.661573 (+ 86us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:56.661801 (+ 228us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:56.661975 (+ 174us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:56.662450 (+ 475us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:56.663028 (+ 578us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:56.663148 (+ 120us) write_op.cc:312] APPLY: finished
0812 19:26:56.663665 (+ 517us) log.cc:842] Serialized 23 byte log entry
0812 19:26:56.665814 (+ 2149us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:56.665944 (+ 130us) write_op.cc:454] Released schema lock
0812 19:26:56.666007 (+ 63us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:56.666921 (+ 914us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:56.667014 (+ 93us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":371956480,"child_traces":[["op",{"apply.queue_time_us":193,"apply.run_cpu_time_us":3210,"apply.run_wall_time_us":5819,"num_ops":1,"prepare.queue_time_us":115,"prepare.run_cpu_time_us":1964,"prepare.run_wall_time_us":4932,"raft.queue_time_us":92,"raft.run_cpu_time_us":1412,"raft.run_wall_time_us":2629,"replication_time_us":190020}]]}
I20260812 19:26:57.072111 8627 ts_tablet_manager.cc:1428] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.035s user 0.006s sys 0.001s
W20260812 19:26:57.082279 7959 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 24) took 2471 ms (client timeout 1000 ms). Trace:
I20260812 19:26:57.082247 8910 leader_election.cc:288] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:57.082865 7959 rpcz_store.cc:269] 0812 19:26:54.610719 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:54.628350 (+ 17631us) service_pool.cc:227] Handling call
0812 19:26:57.082155 (+2453805us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:56.190116 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:56.190541 (+ 425us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:56.190565 (+ 24us) write_op.cc:435] Acquired schema lock
0812 19:26:56.190578 (+ 13us) tablet.cc:660] Decoding operations
0812 19:26:56.190882 (+ 304us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:56.190919 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:56.190939 (+ 20us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:56.191187 (+ 248us) tablet.cc:699] Row locks acquired
0812 19:26:56.191200 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:56.191312 (+ 112us) write_op.cc:270] Start()
0812 19:26:56.191383 (+ 71us) write_op.cc:276] Timestamp: P: 1786562816191216 usec, L: 0
0812 19:26:56.191400 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:26:56.191964 (+ 564us) log.cc:842] Serialized 913 byte log entry
0812 19:26:56.490988 (+299024us) op_driver.cc:444] REPLICATION: finished
0812 19:26:56.598808 (+107820us) write_op.cc:301] APPLY: starting
0812 19:26:56.598867 (+ 59us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:56.598982 (+ 115us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:56.599103 (+ 121us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:56.599446 (+ 343us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:56.599586 (+ 140us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:56.599640 (+ 54us) write_op.cc:312] APPLY: finished
0812 19:26:56.599849 (+ 209us) log.cc:842] Serialized 29 byte log entry
0812 19:26:56.600003 (+ 154us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:56.600072 (+ 69us) write_op.cc:454] Released schema lock
0812 19:26:56.600105 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:56.600326 (+ 221us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:56.600349 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":126931,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":107462,"apply.run_cpu_time_us":1797,"apply.run_wall_time_us":1797,"num_ops":2,"prepare.queue_time_us":72117,"prepare.run_cpu_time_us":1976,"prepare.run_wall_time_us":94264,"replication_time_us":299404}]]}
I20260812 19:26:57.036031 8623 ts_tablet_manager.cc:1428] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.069s user 0.003s sys 0.005s
I20260812 19:26:57.115295 8623 tablet_bootstrap.cc:492] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:57.131414 9055 raft_consensus.cc:482] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:57.132150 9055 raft_consensus.cc:504] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.137063 8627 tablet_bootstrap.cc:492] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:57.149000 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet a1bd8f6905c24ae19c3370246028f7fd with delete_type TABLET_DATA_DELETED (replaced by tablet 384506029b4e49639f87f6d7005fa0a9) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.150568 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet dab1e77a362d483788ac38318df3b58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:57.151134 8108 leader_election.cc:341] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 5f73e97db5954612ab9dfa21bc435efd
I20260812 19:26:57.152846 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 77445461e7f24c1e80bedb96b2af5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:57.156884 8443 leader_election.cc:341] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd
W20260812 19:26:57.159209 8107 leader_election.cc:341] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.165678 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49351be8d2a40109d88b54db11c4489" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:57.168741 8281 leader_election.cc:341] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.170666 8933 tablet_replica.cc:330] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:57.172899 8933 raft_consensus.cc:2229] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:57.173918 8933 raft_consensus.cc:2258] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:57.173053 9055 leader_election.cc:288] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:57.174619 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49351be8d2a40109d88b54db11c4489" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:57.176975 8278 leader_election.cc:341] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.177389 8278 leader_election.cc:302] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:57.177628 8623 tablet_bootstrap.cc:654] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:57.180519 9055 raft_consensus.cc:2726] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:57.181068 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f73e97db5954612ab9dfa21bc435efd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:57.181962 8516 raft_consensus.cc:3037] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:57.192827 8627 tablet_bootstrap.cc:654] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:57.202698 8910 raft_consensus.cc:482] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:57.203894 8910 raft_consensus.cc:504] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:57.207087 8910 leader_election.cc:288] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:57.208819 8108 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:26:57.210592 8869 raft_consensus.cc:504] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:57.217231 8623 tablet_bootstrap.cc:492] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:57.217645 8623 ts_tablet_manager.cc:1397] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.103s user 0.009s sys 0.007s
I20260812 19:26:57.224192 8627 tablet_bootstrap.cc:492] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:57.224944 8627 ts_tablet_manager.cc:1397] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.088s user 0.020s sys 0.004s
W20260812 19:26:57.225824 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 489109us
I20260812 19:26:57.240576 8627 raft_consensus.cc:348] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.241624 8627 raft_consensus.cc:374] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:57.241989 8627 raft_consensus.cc:729] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:57.246604 7952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_5cdd162632bc4043adb1f98902dc836b" } modify_external_catalogs: true
I20260812 19:26:57.247354 7952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_5cdd162632bc4043adb1f98902dc836b" } modify_external_catalogs: true
I20260812 19:26:57.219877 8623 raft_consensus.cc:348] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.252971 8623 raft_consensus.cc:374] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:57.252595 8627 consensus_queue.cc:260] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.260422 8623 raft_consensus.cc:729] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:57.261004 8356 raft_consensus.cc:2454] T 11eb974d35ba42418292e5a9fa82e331 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:57.262586 8108 leader_election.cc:302] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:57.264305 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bfebac9602f494eb19772589992f888 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.264531 8910 raft_consensus.cc:2781] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:57.265298 8910 raft_consensus.cc:686] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:57.266737 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.266616 8910 consensus_queue.cc:237] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:57.268482 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.274412 7962 master_service.cc:946] ReplaceTablet: received request to replace tablet a49e46c8ba704680bf12423854883b55 from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:57.275498 8627 ts_tablet_manager.cc:1428] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.050s user 0.008s sys 0.000s
I20260812 19:26:57.297698 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet decf138a91394c939f686ff127ca7922 (table default.Table_8f4b0588af9946aa8241760c94c19731 [id=a42276cd79314914b1b737784de7fd98]) successfully deleted
W20260812 19:26:57.258764 8107 leader_election.cc:341] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.299499 8107 leader_election.cc:302] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:57.300619 8627 tablet_bootstrap.cc:492] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:57.301194 9049 raft_consensus.cc:2726] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:57.261309 8623 consensus_queue.cc:260] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.284065 8493 tablet_service.cc:1514] Processing DeleteTablet for tablet 650cd08798724b6cb5f7026cd0631b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:54 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:57.286242 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7cfdcedbaf4db7b510dd8e9f5ae867" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:57.298050 9029 consensus_queue.cc:1035] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:26:57.304239 8623 ts_tablet_manager.cc:1428] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.086s user 0.006s sys 0.000s
I20260812 19:26:57.315760 8933 ts_tablet_manager.cc:1905] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:57.308085 8107 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.318471 8107 leader_election.cc:302] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:57.319897 9046 raft_consensus.cc:2726] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:57.329313 9049 raft_consensus.cc:482] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:57.330132 9049 raft_consensus.cc:504] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.313553 8623 tablet_bootstrap.cc:492] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:57.384977 9049 leader_election.cc:288] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:57.393079 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eec275b2131d4848ae120d8a841a1cae" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:57.394029 8356 raft_consensus.cc:2454] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:57.395721 8108 leader_election.cc:302] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:57.397080 9049 raft_consensus.cc:2781] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:57.398080 9049 raft_consensus.cc:482] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:57.398800 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cb55b45c8db944b18d1fcc0ea92dbebd" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:26:57.399407 9049 raft_consensus.cc:3037] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:57.399730 8179 raft_consensus.cc:3037] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:57.411702 8623 tablet_bootstrap.cc:654] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:57.415407 8627 tablet_bootstrap.cc:654] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:57.419867 8179 raft_consensus.cc:2454] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:26:57.421293 9083 tablet.cc:1722] T 355b9f4f5ada428789aa871c888843e1 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:57.357203 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eec275b2131d4848ae120d8a841a1cae" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:57.444729 9049 raft_consensus.cc:504] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.459462 9049 leader_election.cc:288] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:57.362707 8486 consensus_meta.cc:287] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.520s user 0.005s sys 0.006s
I20260812 19:26:57.463227 7959 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 538d05c5883d4575b8eb5d42dfb3c246 (table default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c]). Expected version 2 got 1
I20260812 19:26:57.462868 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eec275b2131d4848ae120d8a841a1cae" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:57.463878 8355 raft_consensus.cc:3037] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:57.464404 7959 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 355b9f4f5ada428789aa871c888843e1 (table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569]). Expected version 1 got 0
I20260812 19:26:57.465214 7959 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:57.465888 7959 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:26:57.473559 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:57.477303 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 355b9f4f5ada428789aa871c888843e1 (table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569]). Expected version 1 got 0
I20260812 19:26:57.382594 8516 raft_consensus.cc:2454] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:57.463856 9087 tablet.cc:1722] T 355b9f4f5ada428789aa871c888843e1 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:57.485306 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_7bbd6b066d084c81b9307f7db324d95f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:57.487398 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7bbd6b066d084c81b9307f7db324d95f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:57.476320 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 2b04529031f04302846b39d585d74ad5 (DEFAULT_TABLE table=default.Table_2c80f7680532421eba6c258b2820ae59 [id=43c68f9d1c484e8e8ae9c431c099d551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.488734 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_604fc9ff0c7e495ab501f9da7792f4d7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:57.489694 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b04529031f04302846b39d585d74ad5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:57.490530 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_604fc9ff0c7e495ab501f9da7792f4d7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:57.478132 8625 ts_tablet_manager.cc:1918] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:57.497149 8625 log.cc:1196] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/650cd08798724b6cb5f7026cd0631b65
I20260812 19:26:57.498183 8625 ts_tablet_manager.cc:1939] T 650cd08798724b6cb5f7026cd0631b65 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:57.484189 8355 raft_consensus.cc:2454] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:57.502637 8108 leader_election.cc:302] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:57.505415 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6 [id=207aa714585c4a20a2ccb8fc894c04b4]) successfully deleted
W20260812 19:26:57.506677 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet a1bd8f6905c24ae19c3370246028f7fd because the tablet was not found. No further retry: Not found: Tablet not found: a1bd8f6905c24ae19c3370246028f7fd
I20260812 19:26:57.508581 9049 raft_consensus.cc:2781] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:57.509549 9049 raft_consensus.cc:686] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
W20260812 19:26:57.517270 8107 leader_election.cc:341] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.516505 9049 consensus_queue.cc:237] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:57.518393 8107 consensus_peers.cc:487] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:57.526638 8625 tablet_replica.cc:330] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:57.527714 8625 raft_consensus.cc:2229] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:57.528395 8625 raft_consensus.cc:2258] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:57.527143 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet dab1e77a362d483788ac38318df3b58a because the tablet was not found. No further retry: Not found: Tablet not found: dab1e77a362d483788ac38318df3b58a
W20260812 19:26:57.391201 8443 consensus_peers.cc:487] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77445461e7f24c1e80bedb96b2af5daf. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:57.478824 7960 catalog_manager.cc:5495] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:57.537833 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 1950030ab501429a91971f80f761a172 (table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]). Expected version 1 got 0
I20260812 19:26:57.538756 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 538d05c5883d4575b8eb5d42dfb3c246 (table default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c]). Expected version 2 got 1
I20260812 19:26:57.540072 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:26:57.540791 7956 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_f429f2bd365a4d5fa9bd32e3d490473b [id=a7e6cd0f83cc491cb3f68098aab6dbab] alter complete (version 2)
W20260812 19:26:57.542326 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 29) took 2291 ms (client timeout 1000 ms). Trace:
W20260812 19:26:57.542594 7956 rpcz_store.cc:269] 0812 19:26:55.251519 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:55.251717 (+ 198us) service_pool.cc:227] Handling call
0812 19:26:57.542267 (+2290550us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:57.251461 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:57.251979 (+ 518us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:57.252027 (+ 48us) write_op.cc:435] Acquired schema lock
0812 19:26:57.252049 (+ 22us) tablet.cc:660] Decoding operations
0812 19:26:57.252381 (+ 332us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:57.252421 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:57.252446 (+ 25us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:57.252622 (+ 176us) tablet.cc:699] Row locks acquired
0812 19:26:57.252642 (+ 20us) write_op.cc:260] PREPARE: finished
0812 19:26:57.252778 (+ 136us) write_op.cc:270] Start()
0812 19:26:57.252859 (+ 81us) write_op.cc:276] Timestamp: P: 1786562817252708 usec, L: 0
0812 19:26:57.252875 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:26:57.253413 (+ 538us) log.cc:842] Serialized 356 byte log entry
0812 19:26:57.364307 (+110894us) op_driver.cc:444] REPLICATION: finished
0812 19:26:57.370079 (+ 5772us) write_op.cc:301] APPLY: starting
0812 19:26:57.370177 (+ 98us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:57.370348 (+ 171us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:57.370597 (+ 249us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:57.370926 (+ 329us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:57.371176 (+ 250us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:57.371255 (+ 79us) write_op.cc:312] APPLY: finished
0812 19:26:57.371594 (+ 339us) log.cc:842] Serialized 23 byte log entry
0812 19:26:57.377926 (+ 6332us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:57.378057 (+ 131us) write_op.cc:454] Released schema lock
0812 19:26:57.378118 (+ 61us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:57.378409 (+ 291us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:57.378461 (+ 52us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":86205,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":5588,"apply.run_cpu_time_us":2575,"apply.run_wall_time_us":8620,"num_ops":1,"prepare.queue_time_us":184601,"prepare.run_cpu_time_us":2152,"prepare.run_wall_time_us":2151,"replication_time_us":111354}]]}
I20260812 19:26:57.545117 8625 ts_tablet_manager.cc:1905] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:57.547075 8910 raft_consensus.cc:482] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:57.547659 8910 raft_consensus.cc:504] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.551141 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:57.551759 8910 leader_election.cc:288] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:57.553184 7958 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d] alter complete (version 2)
I20260812 19:26:57.553519 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:57.554664 8355 raft_consensus.cc:2454] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:57.556627 8108 leader_election.cc:302] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:57.557801 8910 raft_consensus.cc:2781] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:57.558197 8910 raft_consensus.cc:482] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:57.558576 8910 raft_consensus.cc:3037] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:57.561638 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 33591e906f0e433d98e07e424ea0b07f (DEFAULT_TABLE table=default.Table_c4c3334f5a0b4458b574b4398a96f702 [id=ab7a42f74d6646a7a5fc1f6e0484ab95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.563627 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 33591e906f0e433d98e07e424ea0b07f (DEFAULT_TABLE table=default.Table_c4c3334f5a0b4458b574b4398a96f702 [id=ab7a42f74d6646a7a5fc1f6e0484ab95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.564711 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33591e906f0e433d98e07e424ea0b07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.565578 8332 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 129) took 1098 ms. Trace:
I20260812 19:26:57.569069 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 2b04529031f04302846b39d585d74ad5 (DEFAULT_TABLE table=default.Table_2c80f7680532421eba6c258b2820ae59 [id=43c68f9d1c484e8e8ae9c431c099d551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.570412 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b04529031f04302846b39d585d74ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.571436 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33591e906f0e433d98e07e424ea0b07f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:57.575968 7957 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 30) took 2166 ms (client timeout 1000 ms). Trace:
W20260812 19:26:57.585841 7955 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 30) took 1326 ms (client timeout 1000 ms). Trace:
W20260812 19:26:57.586726 7955 rpcz_store.cc:269] 0812 19:26:56.259666 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.282480 (+ 22814us) service_pool.cc:227] Handling call
0812 19:26:56.460127 (+177647us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:57.585688 (+1125561us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24943,"reported_tablets":11,"spinlock_wait_cycles":389345536}
I20260812 19:26:57.591391 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:57.591435 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:44394
W20260812 19:26:57.579377 7957 rpcz_store.cc:269] 0812 19:26:55.409862 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:55.410044 (+ 182us) service_pool.cc:227] Handling call
0812 19:26:57.575894 (+2165850us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:56.778748 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:56.779080 (+ 332us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:56.779100 (+ 20us) write_op.cc:435] Acquired schema lock
0812 19:26:56.779111 (+ 11us) tablet.cc:660] Decoding operations
0812 19:26:56.779342 (+ 231us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:56.779374 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:56.779398 (+ 24us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:56.779520 (+ 122us) tablet.cc:699] Row locks acquired
0812 19:26:56.779531 (+ 11us) write_op.cc:260] PREPARE: finished
0812 19:26:56.813112 (+ 33581us) write_op.cc:270] Start()
0812 19:26:56.813232 (+ 120us) write_op.cc:276] Timestamp: P: 1786562816813040 usec, L: 0
0812 19:26:56.813252 (+ 20us) op_driver.cc:331] REPLICATION: starting
0812 19:26:56.814012 (+ 760us) log.cc:842] Serialized 533 byte log entry
0812 19:26:57.017627 (+203615us) op_driver.cc:444] REPLICATION: finished
0812 19:26:57.020558 (+ 2931us) write_op.cc:301] APPLY: starting
0812 19:26:57.020674 (+ 116us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:57.020912 (+ 238us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:57.021164 (+ 252us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:57.021632 (+ 468us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:57.021901 (+ 269us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:57.021982 (+ 81us) write_op.cc:312] APPLY: finished
0812 19:26:57.022274 (+ 292us) log.cc:842] Serialized 23 byte log entry
0812 19:26:57.022517 (+ 243us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:57.022648 (+ 131us) write_op.cc:454] Released schema lock
0812 19:26:57.022705 (+ 57us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:57.022971 (+ 266us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:57.023017 (+ 46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":2598,"apply.run_cpu_time_us":2698,"apply.run_wall_time_us":2699,"num_ops":1,"prepare.queue_time_us":61099,"prepare.run_cpu_time_us":3490,"prepare.run_wall_time_us":35496,"replication_time_us":204209}]]}
I20260812 19:26:57.612730 7952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 14f1198fb9b646b5ae473cfbdfcd7a8d
I20260812 19:26:57.615363 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_abc701c69d604e08b2c81f972eeeb6e8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:57.620028 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:57.566076 8332 rpcz_store.cc:276] 0812 19:26:56.467147 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.467369 (+ 222us) service_pool.cc:227] Handling call
0812 19:26:56.469687 (+ 2318us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:56.469836 (+ 149us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:57.003771 (+533935us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:57.428550 (+424779us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:57.565248 (+136698us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:26:57.622171 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 7e087bad986b423098a68fa5d05ff17a (DEFAULT_TABLE table=default.Table_118fda3ccbbb4a1f9e380936b8ad2002 [id=fb515bf5502345ababa0a4e81dc8874d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.621587 8910 raft_consensus.cc:504] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.623314 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e087bad986b423098a68fa5d05ff17a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:57.627518 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_abc701c69d604e08b2c81f972eeeb6e8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:57.634636 9083 tablet.cc:1722] T 538d05c5883d4575b8eb5d42dfb3c246 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260812 19:26:57.639685 7958 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 25) took 1927 ms (client timeout 1000 ms). Trace:
I20260812 19:26:57.640988 8623 tablet_bootstrap.cc:492] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:57.641494 8623 ts_tablet_manager.cc:1397] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.328s user 0.009s sys 0.009s
I20260812 19:26:57.645524 8623 raft_consensus.cc:348] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.646500 8623 raft_consensus.cc:374] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:57.646816 8623 raft_consensus.cc:729] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:57.647567 8623 consensus_queue.cc:260] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.650035 8623 ts_tablet_manager.cc:1428] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20260812 19:26:57.673043 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:57.674185 8355 raft_consensus.cc:3037] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:57.677042 9096 tablet.cc:1722] T 538d05c5883d4575b8eb5d42dfb3c246 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:57.680917 8623 tablet_bootstrap.cc:492] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:57.688405 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 95e195a643084486a74be961177bf42c (DEFAULT_TABLE table=default.Table_82549cc5780a4115ac93fa50541bd102 [id=937c9f4b3b8546d6958017575c2ca587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.689194 8910 leader_election.cc:288] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:57.692350 8328 tablet_service.cc:1467] Processing CreateTablet for tablet f57f252b520945328fdaaa9adef593a1 (DEFAULT_TABLE table=default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a [id=c7693e18a1794f2391e8364b84c09f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.696525 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.697870 9037 ts_tablet_manager.cc:1918] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:57.699842 8157 tablet_service.cc:1467] Processing CreateTablet for tablet b31c1afb090041d7b6ae35a846772b1d (DEFAULT_TABLE table=default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.700940 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b31c1afb090041d7b6ae35a846772b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.705574 8152 tablet_service.cc:1467] Processing CreateTablet for tablet 95e195a643084486a74be961177bf42c (DEFAULT_TABLE table=default.Table_82549cc5780a4115ac93fa50541bd102 [id=937c9f4b3b8546d6958017575c2ca587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.707901 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e195a643084486a74be961177bf42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.708034 9037 log.cc:1196] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/650cd08798724b6cb5f7026cd0631b65
I20260812 19:26:57.698895 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e195a643084486a74be961177bf42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.709594 9037 ts_tablet_manager.cc:1939] T 650cd08798724b6cb5f7026cd0631b65 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:57.712833 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57f252b520945328fdaaa9adef593a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.728667 8326 tablet_service.cc:1467] Processing CreateTablet for tablet 968eb13e27ea4f93a45aad17110b0ee4 (DEFAULT_TABLE table=default.Table_6f43770d0ded42fca9530db781825e48 [id=97f951f5bce143dbac6324c558577701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.696005 8355 raft_consensus.cc:2454] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:57.729568 8323 tablet_service.cc:1467] Processing CreateTablet for tablet 384506029b4e49639f87f6d7005fa0a9 (DEFAULT_TABLE table=default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.733208 8108 leader_election.cc:302] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:57.712975 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 7e087bad986b423098a68fa5d05ff17a (DEFAULT_TABLE table=default.Table_118fda3ccbbb4a1f9e380936b8ad2002 [id=fb515bf5502345ababa0a4e81dc8874d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.734567 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e087bad986b423098a68fa5d05ff17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.720561 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 650cd08798724b6cb5f7026cd0631b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:54 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.737203 9095 raft_consensus.cc:2781] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:57.738574 9095 raft_consensus.cc:686] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:57.738956 8625 ts_tablet_manager.cc:1918] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:57.739323 8625 log.cc:1196] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/77445461e7f24c1e80bedb96b2af5daf
I20260812 19:26:57.740047 8625 ts_tablet_manager.cc:1939] T 77445461e7f24c1e80bedb96b2af5daf P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:57.739466 9095 consensus_queue.cc:237] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.724157 8623 tablet_bootstrap.cc:654] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:57.649385 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_3421abe40de04cbbada9c7c0e77840a8"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:57.748613 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.657012 7962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet a49e46c8ba704680bf12423854883b55
I20260812 19:26:57.749879 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet dab1e77a362d483788ac38318df3b58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.750494 7962 catalog_manager.cc:6565] ReplaceTablet: tablet a49e46c8ba704680bf12423854883b55 deleted and replaced by tablet b4d07516dc1c4193b4cbd68185f92891
I20260812 19:26:57.750948 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.751971 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet f313502f35a046188c4b24c10b762c7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:52 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:57.753093 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3421abe40de04cbbada9c7c0e77840a8 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:57.754487 8156 tablet_service.cc:1467] Processing CreateTablet for tablet f57f252b520945328fdaaa9adef593a1 (DEFAULT_TABLE table=default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a [id=c7693e18a1794f2391e8364b84c09f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.756526 8322 tablet_service.cc:1514] Processing DeleteTablet for tablet a49e46c8ba704680bf12423854883b55 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d07516dc1c4193b4cbd68185f92891) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:57.760308 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet a1bd8f6905c24ae19c3370246028f7fd with delete_type TABLET_DATA_DELETED (replaced by tablet 384506029b4e49639f87f6d7005fa0a9) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.725030 7957 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ad6af655b663482b88244d72f58c34c0" } modify_external_catalogs: true
I20260812 19:26:57.760742 8623 tablet_bootstrap.cc:492] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:57.761163 8623 ts_tablet_manager.cc:1397] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.080s user 0.013s sys 0.003s
I20260812 19:26:57.761152 7957 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ad6af655b663482b88244d72f58c34c0" } modify_external_catalogs: true
I20260812 19:26:57.764015 8322 tablet_service.cc:1467] Processing CreateTablet for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d (DEFAULT_TABLE table=default.Table_5cdd162632bc4043adb1f98902dc836b [id=9bf3be1cb6fa4355996e661c5b24902d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.764932 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57f252b520945328fdaaa9adef593a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.776505 8623 raft_consensus.cc:348] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.777268 8623 raft_consensus.cc:374] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:57.777513 8625 tablet_replica.cc:330] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:57.778545 8625 raft_consensus.cc:2229] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260812 19:26:57.395394 8511 consensus_meta.cc:287] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.589s user 0.004s sys 0.010s
I20260812 19:26:57.397120 8869 leader_election.cc:288] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:57.429383 8446 leader_election.cc:302] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
W20260812 19:26:57.780974 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 351654us
I20260812 19:26:57.731815 8332 tablet_service.cc:1467] Processing CreateTablet for tablet b31c1afb090041d7b6ae35a846772b1d (DEFAULT_TABLE table=default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.511519 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eec275b2131d4848ae120d8a841a1cae" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:57.497402 9084 tablet.cc:1722] T 355b9f4f5ada428789aa871c888843e1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260812 19:26:57.531663 8487 consensus_meta.cc:287] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.631s user 0.007s sys 0.003s
W20260812 19:26:57.790895 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 92744.2us
I20260812 19:26:57.790974 8490 tablet_service.cc:1467] Processing CreateTablet for tablet 33591e906f0e433d98e07e424ea0b07f (DEFAULT_TABLE table=default.Table_c4c3334f5a0b4458b574b4398a96f702 [id=ab7a42f74d6646a7a5fc1f6e0484ab95]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.791913 8490 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 33591e906f0e433d98e07e424ea0b07f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.791983 8627 tablet_bootstrap.cc:492] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:57.792484 8627 ts_tablet_manager.cc:1397] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.492s user 0.048s sys 0.102s
I20260812 19:26:57.796838 8627 raft_consensus.cc:348] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.797773 8627 raft_consensus.cc:374] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:57.798096 8627 raft_consensus.cc:729] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:57.798827 8627 consensus_queue.cc:260] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.802614 8494 tablet_service.cc:1467] Processing CreateTablet for tablet 7e087bad986b423098a68fa5d05ff17a (DEFAULT_TABLE table=default.Table_118fda3ccbbb4a1f9e380936b8ad2002 [id=fb515bf5502345ababa0a4e81dc8874d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.807631 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet decf138a91394c939f686ff127ca7922 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:47 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:57.746366 7958 rpcz_store.cc:269] 0812 19:26:55.712486 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.095631 (+383145us) service_pool.cc:227] Handling call
0812 19:26:57.639612 (+1543981us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:57.042503 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:57.042883 (+ 380us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:57.042910 (+ 27us) write_op.cc:435] Acquired schema lock
0812 19:26:57.042922 (+ 12us) tablet.cc:660] Decoding operations
0812 19:26:57.043188 (+ 266us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:57.043232 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:57.043253 (+ 21us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:57.043397 (+ 144us) tablet.cc:699] Row locks acquired
0812 19:26:57.043410 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:57.043530 (+ 120us) write_op.cc:270] Start()
0812 19:26:57.043638 (+ 108us) write_op.cc:276] Timestamp: P: 1786562817043463 usec, L: 0
0812 19:26:57.043655 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:26:57.249560 (+205905us) log.cc:842] Serialized 356 byte log entry
0812 19:26:57.251103 (+ 1543us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64471 00007f05eeedb198 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9 00007f05ef340ab1 00007f05ef33fdad 0000000000580784 00000000005805b9
0812 19:26:57.364027 (+112924us) op_driver.cc:444] REPLICATION: finished
0812 19:26:57.366375 (+ 2348us) write_op.cc:301] APPLY: starting
0812 19:26:57.366501 (+ 126us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:57.366715 (+ 214us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:57.366762 (+ 47us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:57.367231 (+ 469us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:57.367579 (+ 348us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:57.367705 (+ 126us) write_op.cc:312] APPLY: finished
0812 19:26:57.368151 (+ 446us) log.cc:842] Serialized 23 byte log entry
0812 19:26:57.369047 (+ 896us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:57.369131 (+ 84us) write_op.cc:454] Released schema lock
0812 19:26:57.369185 (+ 54us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:57.369503 (+ 318us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:57.369580 (+ 77us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":2046,"apply.run_cpu_time_us":2903,"apply.run_wall_time_us":3466,"num_ops":1,"prepare.queue_time_us":2875,"prepare.run_cpu_time_us":5594,"prepare.run_wall_time_us":208793,"replication_time_us":320273,"spinlock_wait_cycles":471589760}]]}
I20260812 19:26:57.811769 8627 ts_tablet_manager.cc:1428] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.019s user 0.005s sys 0.003s
I20260812 19:26:57.476066 8325 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 128) took 1056 ms. Trace:
I20260812 19:26:57.813090 8325 rpcz_store.cc:276] 0812 19:26:56.419861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.423231 (+ 3370us) service_pool.cc:227] Handling call
0812 19:26:56.445259 (+ 22028us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:56.445419 (+ 160us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:56.951914 (+506495us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:57.475318 (+523404us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:57.475998 (+ 680us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:26:57.814261 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 384506029b4e49639f87f6d7005fa0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.821784 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968eb13e27ea4f93a45aad17110b0ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.788480 9029 raft_consensus.cc:2781] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:57.827327 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 77445461e7f24c1e80bedb96b2af5daf (table default.Table_3450db0f15ec43dfb63b86b025614242 [id=23c4b17280f540ddacaf2fe8b08715c9]) successfully deleted
I20260812 19:26:57.827977 8627 tablet_bootstrap.cc:492] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:26:57.828576 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 5bfebac9602f494eb19772589992f888 because the tablet was not found. No further retry: Not found: Tablet not found: 5bfebac9602f494eb19772589992f888
W20260812 19:26:57.829578 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet decf138a91394c939f686ff127ca7922 because the tablet was not found. No further retry: Not found: Tablet not found: decf138a91394c939f686ff127ca7922
W20260812 19:26:57.830221 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 2a43b5f9446b4ed4a0349af7d8c16f8f because the tablet was not found. No further retry: Not found: Tablet not found: 2a43b5f9446b4ed4a0349af7d8c16f8f
W20260812 19:26:57.831034 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d because the tablet was not found. No further retry: Not found: Tablet not found: 14f1198fb9b646b5ae473cfbdfcd7a8d
W20260812 19:26:57.831691 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 650cd08798724b6cb5f7026cd0631b65 because the tablet was not found. No further retry: Not found: Tablet not found: 650cd08798724b6cb5f7026cd0631b65
I20260812 19:26:57.833657 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:57.796219 8488 consensus_meta.cc:287] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.920s user 0.009s sys 0.006s
I20260812 19:26:57.822737 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet a1bd8f6905c24ae19c3370246028f7fd with delete_type TABLET_DATA_DELETED (replaced by tablet 384506029b4e49639f87f6d7005fa0a9) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:57.786435 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 389988us
I20260812 19:26:57.777519 8623 raft_consensus.cc:729] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:57.844677 8625 raft_consensus.cc:2258] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:57.819840 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 2b04529031f04302846b39d585d74ad5 (DEFAULT_TABLE table=default.Table_2c80f7680532421eba6c258b2820ae59 [id=43c68f9d1c484e8e8ae9c431c099d551]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.845197 8623 consensus_queue.cc:260] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.811918 9095 consensus_queue.cc:1035] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:57.816100 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 968eb13e27ea4f93a45aad17110b0ee4 (DEFAULT_TABLE table=default.Table_6f43770d0ded42fca9530db781825e48 [id=97f951f5bce143dbac6324c558577701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.817839 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet a49e46c8ba704680bf12423854883b55 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d07516dc1c4193b4cbd68185f92891) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:57.825443 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 384506029b4e49639f87f6d7005fa0a9 (DEFAULT_TABLE table=default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.846370 8625 ts_tablet_manager.cc:1905] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:57.846969 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 384506029b4e49639f87f6d7005fa0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.847823 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968eb13e27ea4f93a45aad17110b0ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.818689 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e087bad986b423098a68fa5d05ff17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.850349 9037 tablet_replica.cc:330] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:57.851284 9037 raft_consensus.cc:2229] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:57.851574 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b31c1afb090041d7b6ae35a846772b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.851780 9037 raft_consensus.cc:2258] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:57.854285 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_6f43770d0ded42fca9530db781825e48" } new_table_name: "default.Table_c30c4f84e6034b5f84410839aeafaef4" modify_external_catalogs: true
I20260812 19:26:57.860044 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet 77445461e7f24c1e80bedb96b2af5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:57.862723 8623 ts_tablet_manager.cc:1428] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.101s user 0.001s sys 0.007s
I20260812 19:26:57.863971 8623 tablet_bootstrap.cc:492] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:57.864877 7962 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d84b58b9c9354801afc338f0751ada49" } new_table_name: "default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68" modify_external_catalogs: true
I20260812 19:26:57.870771 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3e9699a08d4b49aa9f6e7b830481562a" } modify_external_catalogs: true
I20260812 19:26:57.872790 9037 ts_tablet_manager.cc:1905] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:57.874002 8136 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:33112 (request call id 9) took 1357 ms. Trace:
I20260812 19:26:57.877117 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2b04529031f04302846b39d585d74ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.868738 8627 tablet_bootstrap.cc:654] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:57.882480 8910 raft_consensus.cc:482] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:57.883276 8910 raft_consensus.cc:504] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.885469 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3e9699a08d4b49aa9f6e7b830481562a" } modify_external_catalogs: true
I20260812 19:26:57.890504 8107 leader_election.cc:302] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:26:57.891736 8107 leader_election.cc:341] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:57.877562 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet dab1e77a362d483788ac38318df3b58a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:57.889822 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:57.893078 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:57.901393 9029 raft_consensus.cc:686] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:26:57.904947 9029 consensus_queue.cc:237] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:57.898224 9046 raft_consensus.cc:2781] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:57.911792 9046 raft_consensus.cc:686] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:57.912602 9046 consensus_queue.cc:237] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.917507 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49351be8d2a40109d88b54db11c4489" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:57.918130 8355 raft_consensus.cc:2454] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:57.918745 8910 leader_election.cc:288] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:57.919816 8108 leader_election.cc:302] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:57.920674 8910 raft_consensus.cc:2781] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:57.921000 8910 raft_consensus.cc:482] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:57.921283 8910 raft_consensus.cc:3037] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:57.907800 9097 log.cc:924] Time spent T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.119s user 0.000s sys 0.001s
I20260812 19:26:57.934149 8623 tablet_bootstrap.cc:654] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:57.950160 8627 tablet_bootstrap.cc:492] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:57.950739 8627 ts_tablet_manager.cc:1397] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.123s user 0.004s sys 0.008s
I20260812 19:26:57.952644 9095 raft_consensus.cc:482] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:57.906440 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:57.908397 8485 tablet_service.cc:1467] Processing CreateTablet for tablet b31c1afb090041d7b6ae35a846772b1d (DEFAULT_TABLE table=default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.973634 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b31c1afb090041d7b6ae35a846772b1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.910667 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 95e195a643084486a74be961177bf42c (DEFAULT_TABLE table=default.Table_82549cc5780a4115ac93fa50541bd102 [id=937c9f4b3b8546d6958017575c2ca587]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.911881 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f73e97db5954612ab9dfa21bc435efd with delete_type TABLET_DATA_DELETED (replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:57.937222 8484 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:57.941951 8483 tablet_service.cc:1467] Processing CreateTablet for tablet f57f252b520945328fdaaa9adef593a1 (DEFAULT_TABLE table=default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a [id=c7693e18a1794f2391e8364b84c09f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.946580 8482 tablet_service.cc:1467] Processing CreateTablet for tablet 968eb13e27ea4f93a45aad17110b0ee4 (DEFAULT_TABLE table=default.Table_6f43770d0ded42fca9530db781825e48 [id=97f951f5bce143dbac6324c558577701]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:57.979724 9095 raft_consensus.cc:504] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:57.982797 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 95e195a643084486a74be961177bf42c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.985347 9095 leader_election.cc:288] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:57.986009 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "453a403d1c0b4b5c8dcd9b93c7cc9ea4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:57.897855 8136 rpcz_store.cc:276] 0812 19:26:56.541379 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.552213 (+ 10834us) service_pool.cc:227] Handling call
0812 19:26:56.661100 (+108887us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b5400111054. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f983885f268 00007f983984b6cd 00007f98380f3e04 00007f98380f3d92 00007f98380f3cc1 00007f98380f3c3c 00007f98380f2ef2 00007f983662094c 00007f983661fd86 00007f983661f72f
0812 19:26:57.873919 (+1212819us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26107648}
I20260812 19:26:57.986950 8356 raft_consensus.cc:2454] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:57.988802 8108 leader_election.cc:302] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:57.990119 8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f57f252b520945328fdaaa9adef593a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:57.992491 8482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 968eb13e27ea4f93a45aad17110b0ee4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:58.002043 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6 [id=207aa714585c4a20a2ccb8fc894c04b4]) successfully deleted
I20260812 19:26:58.004722 7953 master_service.cc:946] ReplaceTablet: received request to replace tablet 863e7ca808f54a989b3372aa4bfe361e from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:58.006525 9095 raft_consensus.cc:2781] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:58.007321 9095 raft_consensus.cc:482] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:58.008013 9095 raft_consensus.cc:3037] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:57.985168 8627 raft_consensus.cc:348] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.016399 8627 raft_consensus.cc:374] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:58.016721 8627 raft_consensus.cc:729] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:26:58.017419 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 124409us
I20260812 19:26:58.020659 8627 consensus_queue.cc:260] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.023398 9049 raft_consensus.cc:482] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:58.024226 9049 raft_consensus.cc:504] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.029084 9049 leader_election.cc:288] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:58.030063 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:58.031000 8356 raft_consensus.cc:2454] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:26:58.033038 8108 leader_election.cc:302] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:58.048604 8627 ts_tablet_manager.cc:1428] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.098s user 0.008s sys 0.004s
I20260812 19:26:58.053692 8636 tablet_bootstrap.cc:492] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:58.054351 8636 ts_tablet_manager.cc:1397] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 1.732s user 0.018s sys 0.025s
I20260812 19:26:58.061319 8627 tablet_bootstrap.cc:492] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:58.049226 9049 raft_consensus.cc:2781] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:58.067225 9049 raft_consensus.cc:482] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:58.067888 9049 raft_consensus.cc:3037] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:26:58.072189 8107 leader_election.cc:341] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:58.073700 8107 leader_election.cc:341] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:58.075481 9106 log.cc:924] Time spent T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.060s user 0.001s sys 0.000s
I20260812 19:26:58.044243 8625 ts_tablet_manager.cc:1918] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:58.079743 8625 log.cc:1196] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/69fe5774f8dc46308954e9be54bd92b2
I20260812 19:26:58.081115 8625 ts_tablet_manager.cc:1939] T 69fe5774f8dc46308954e9be54bd92b2 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:58.091837 8486 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 117) took 1638 ms. Trace:
I20260812 19:26:58.092588 8486 rpcz_store.cc:276] 0812 19:26:56.453095 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.453395 (+ 300us) service_pool.cc:227] Handling call
0812 19:26:56.459592 (+ 6197us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:56.459790 (+ 198us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:56.842775 (+382985us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:57.793367 (+950592us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:58.091725 (+298358us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":266300}
I20260812 19:26:58.096163 8488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 108) took 1905 ms. Trace:
I20260812 19:26:58.096822 8488 rpcz_store.cc:276] 0812 19:26:56.191237 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.206181 (+ 14944us) service_pool.cc:227] Handling call
0812 19:26:56.207607 (+ 1426us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:56.232078 (+ 24471us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:56.875289 (+643211us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:58.095135 (+1219846us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:58.096064 (+ 929us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":253542}
I20260812 19:26:58.099112 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49351be8d2a40109d88b54db11c4489" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:58.107532 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet a49e46c8ba704680bf12423854883b55 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d07516dc1c4193b4cbd68185f92891) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:58.122242 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:58.125674 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "453a403d1c0b4b5c8dcd9b93c7cc9ea4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:58.128846 9049 raft_consensus.cc:504] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.130743 8491 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 115) took 1701 ms. Trace:
W20260812 19:26:58.133160 8107 leader_election.cc:341] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.132965 8487 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 116) took 1703 ms. Trace:
W20260812 19:26:58.134075 8107 leader_election.cc:341] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.133554 8487 rpcz_store.cc:276] 0812 19:26:56.429535 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.437144 (+ 7609us) service_pool.cc:227] Handling call
0812 19:26:56.449100 (+ 11956us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:56.449204 (+ 104us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:56.899415 (+450211us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:58.090724 (+1191309us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:58.132867 (+ 42143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":307466}
I20260812 19:26:58.136616 9049 leader_election.cc:288] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:58.131325 8491 rpcz_store.cc:276] 0812 19:26:56.429102 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.489002 (+ 59900us) service_pool.cc:227] Handling call
0812 19:26:56.493322 (+ 4320us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:56.493572 (+ 250us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:57.195128 (+701556us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:58.050374 (+855246us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:58.130676 (+ 80302us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":115866}
W20260812 19:26:58.137737 8107 leader_election.cc:341] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.123394 8910 raft_consensus.cc:504] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.142549 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d (DEFAULT_TABLE table=default.Table_5cdd162632bc4043adb1f98902dc836b [id=9bf3be1cb6fa4355996e661c5b24902d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:58.148800 8910 leader_election.cc:288] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:58.155006 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ed3743a7dde744668cbe91759a499805 consensus state has no leader
I20260812 19:26:58.158967 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:26:58.167984 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 650cd08798724b6cb5f7026cd0631b65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:54 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.169179 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f73e97db5954612ab9dfa21bc435efd with delete_type TABLET_DATA_DELETED (replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.173429 9095 raft_consensus.cc:504] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.181452 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:58.182386 8351 raft_consensus.cc:3037] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:58.180429 8625 tablet_replica.cc:330] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:58.186731 8625 raft_consensus.cc:2229] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:58.187348 8625 raft_consensus.cc:2258] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:58.183327 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:58.196719 8625 ts_tablet_manager.cc:1905] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:58.171685 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_62f170365c8247b1ab9704bfc9ec48dc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:58.199855 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_62f170365c8247b1ab9704bfc9ec48dc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:58.183775 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 69fe5774f8dc46308954e9be54bd92b2 (table default.Table_4fce364e6d9545ae96b3b503b1fc5b71 [id=25842a7a7f6f400a867cc04b5ee0f2fd]) successfully deleted
W20260812 19:26:58.203297 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet dab1e77a362d483788ac38318df3b58a because the tablet was not found. No further retry: Not found: Tablet not found: dab1e77a362d483788ac38318df3b58a
I20260812 19:26:58.203080 8910 consensus_queue.cc:1035] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:58.206709 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:26:58.207566 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:26:58.229441 8625 ts_tablet_manager.cc:1918] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:58.229867 8625 log.cc:1196] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/cb55b45c8db944b18d1fcc0ea92dbebd
I20260812 19:26:58.230738 8625 ts_tablet_manager.cc:1939] T cb55b45c8db944b18d1fcc0ea92dbebd P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:58.232405 9095 leader_election.cc:288] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:58.233039 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:58.235127 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49351be8d2a40109d88b54db11c4489" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:58.236442 8623 tablet_bootstrap.cc:492] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:58.236944 8623 ts_tablet_manager.cc:1397] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.373s user 0.014s sys 0.015s
I20260812 19:26:58.239473 8636 raft_consensus.cc:348] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.241729 8623 raft_consensus.cc:348] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.242677 8623 raft_consensus.cc:374] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:58.242998 8623 raft_consensus.cc:729] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:58.251211 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet cb55b45c8db944b18d1fcc0ea92dbebd (table default.Table_ef547861981d429baacbb9286c8fc629 [id=27b6a83f08704d199cbb25ab55bc634b]) successfully deleted
W20260812 19:26:58.252784 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet f313502f35a046188c4b24c10b762c7b because the tablet was not found. No further retry: Not found: Tablet not found: f313502f35a046188c4b24c10b762c7b
I20260812 19:26:58.253057 8625 tablet_replica.cc:330] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:58.253741 8625 raft_consensus.cc:2229] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:58.254431 8625 pending_rounds.cc:62] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:26:58.254628 8625 pending_rounds.cc:68] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761302178254848 op_type: NO_OP noop_request { }
I20260812 19:26:58.254992 8625 raft_consensus.cc:2866] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:58.255366 8625 raft_consensus.cc:2258] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:58.261065 8625 ts_tablet_manager.cc:1905] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:58.243794 8623 consensus_queue.cc:260] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:58.270157 8107 leader_election.cc:341] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:58.271152 8107 leader_election.cc:341] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.276654 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "453a403d1c0b4b5c8dcd9b93c7cc9ea4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:58.240142 8636 raft_consensus.cc:374] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:58.297299 8636 raft_consensus.cc:729] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:58.298203 8636 consensus_queue.cc:260] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.300316 8623 ts_tablet_manager.cc:1428] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.063s user 0.009s sys 0.000s
W20260812 19:26:58.305063 8107 leader_election.cc:341] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.309271 8623 tablet_bootstrap.cc:492] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:58.314615 8625 ts_tablet_manager.cc:1918] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:58.315227 8625 log.cc:1196] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/5f73e97db5954612ab9dfa21bc435efd
I20260812 19:26:58.316215 8625 ts_tablet_manager.cc:1939] T 5f73e97db5954612ab9dfa21bc435efd P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:58.321583 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 384506029b4e49639f87f6d7005fa0a9 (DEFAULT_TABLE table=default.Table_2815136dc6074bab9bcf3a0e4a93fdaa [id=3c0970afdc834aff921d14ba6ab03647]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:58.322602 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 384506029b4e49639f87f6d7005fa0a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:58.196875 9055 raft_consensus.cc:482] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:58.184616 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d49351be8d2a40109d88b54db11c4489" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
W20260812 19:26:58.336213 8107 consensus_peers.cc:487] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:58.336617 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "453a403d1c0b4b5c8dcd9b93c7cc9ea4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:58.337466 8354 raft_consensus.cc:3037] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:58.340590 9055 raft_consensus.cc:504] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.345878 8487 tablet_service.cc:1467] Processing CreateTablet for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d (DEFAULT_TABLE table=default.Table_5cdd162632bc4043adb1f98902dc836b [id=9bf3be1cb6fa4355996e661c5b24902d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:58.348940 9055 leader_election.cc:288] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:58.349318 8636 ts_tablet_manager.cc:1428] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.292s user 0.008s sys 0.001s
I20260812 19:26:58.349617 9055 raft_consensus.cc:482] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:58.350416 9055 raft_consensus.cc:504] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.352119 8487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:58.353817 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29436abddcab4a46adb5aa0c54f45389" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:58.355675 8281 leader_election.cc:341] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.367404 8627 tablet_bootstrap.cc:654] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:58.380570 9037 ts_tablet_manager.cc:1918] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:58.387296 9037 log.cc:1196] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/eec275b2131d4848ae120d8a841a1cae
I20260812 19:26:58.388648 9037 ts_tablet_manager.cc:1939] T eec275b2131d4848ae120d8a841a1cae P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:58.341418 8352 raft_consensus.cc:3037] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:58.396862 8351 raft_consensus.cc:2454] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:58.399977 8108 leader_election.cc:302] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:58.401671 9095 raft_consensus.cc:2781] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:58.402464 9095 raft_consensus.cc:686] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:58.405969 9095 consensus_queue.cc:237] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.410394 8636 tablet_bootstrap.cc:492] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:58.421327 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaaf04a85946447aa43873e3568aa3a3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:58.423647 8281 leader_election.cc:341] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.424607 9055 leader_election.cc:288] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:58.461639 9037 tablet_replica.cc:330] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:26:58.465770 8107 consensus_peers.cc:487] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:58.433251 8443 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.550s user 0.005s sys 0.010s
W20260812 19:26:58.473881 8443 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.591s user 0.005s sys 0.011s
I20260812 19:26:58.483515 8623 tablet_bootstrap.cc:654] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:58.475193 8627 tablet_bootstrap.cc:492] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:58.496598 8627 ts_tablet_manager.cc:1397] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.436s user 0.009s sys 0.012s
I20260812 19:26:58.520197 8627 raft_consensus.cc:348] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.521178 8627 raft_consensus.cc:374] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:58.521469 8627 raft_consensus.cc:729] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:58.522151 8627 consensus_queue.cc:260] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.279817 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 538d05c5883d4575b8eb5d42dfb3c246 (table default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c]). Expected version 2 got 1
I20260812 19:26:58.296681 7957 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet da5f9e7431654d5fbae5d554c6f14569
I20260812 19:26:58.528551 7957 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 166) took 1083 ms. Trace:
I20260812 19:26:58.530099 9117 raft_consensus.cc:482] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:58.530995 9117 raft_consensus.cc:504] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.316511 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_45b01d92b3ad46c381537f61225bdc9c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:58.533625 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_45b01d92b3ad46c381537f61225bdc9c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:58.535351 9117 leader_election.cc:288] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:26:58.320528 7962 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b07f7215876740519164e7d7e08302bd has no consensus state
I20260812 19:26:58.536926 7962 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 167) took 1084 ms. Trace:
I20260812 19:26:58.432580 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet eec275b2131d4848ae120d8a841a1cae (table default.Table_77f5368431cf473daab21a349c850ca8 [id=e680e4a33c234a20be57640b6f7c4e61]) successfully deleted
W20260812 19:26:58.540534 7946 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 108000us
I20260812 19:26:58.524107 8627 ts_tablet_manager.cc:1428] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.027s user 0.000s sys 0.005s
I20260812 19:26:58.545605 8627 tablet_bootstrap.cc:492] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:58.545531 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da5f9e7431654d5fbae5d554c6f14569" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:58.547243 8511 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.144.193:44699 (request call id 83) took 1763 ms. Trace:
W20260812 19:26:58.547926 8281 leader_election.cc:341] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.549317 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:26:58.550302 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 355b9f4f5ada428789aa871c888843e1 (table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569]). Expected version 1 got 0
I20260812 19:26:58.537361 7962 rpcz_store.cc:276] 0812 19:26:57.452756 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.751175 (+298419us) service_pool.cc:227] Handling call
0812 19:26:57.864728 (+113553us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf7d6 00007f05ee9f5634 00007f05ee9f55c2 00007f05ee9f54f1 00007f05ee9f546c 00007f05ee9f4722 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:57.865585 (+ 857us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:57.866473 (+ 888us) catalog_manager.cc:3616] Apply alter schema
0812 19:26:57.867140 (+ 667us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:26:57.867432 (+ 292us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:26:58.319947 (+452515us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:26:58.536838 (+216891us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:58.223062 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:58.223669 (+ 607us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:58.223700 (+ 31us) write_op.cc:435] Acquired schema lock
0812 19:26:58.223713 (+ 13us) tablet.cc:660] Decoding operations
0812 19:26:58.224004 (+ 291us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:58.224046 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:58.224069 (+ 23us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:58.224278 (+ 209us) tablet.cc:699] Row locks acquired
0812 19:26:58.224296 (+ 18us) write_op.cc:260] PREPARE: finished
0812 19:26:58.224413 (+ 117us) write_op.cc:270] Start()
0812 19:26:58.224502 (+ 89us) write_op.cc:276] Timestamp: P: 1786562818224326 usec, L: 0
0812 19:26:58.224523 (+ 21us) op_driver.cc:331] REPLICATION: starting
0812 19:26:58.225031 (+ 508us) log.cc:842] Serialized 405 byte log entry
0812 19:26:58.314903 (+ 89872us) op_driver.cc:444] REPLICATION: finished
0812 19:26:58.317852 (+ 2949us) write_op.cc:301] APPLY: starting
0812 19:26:58.317935 (+ 83us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:58.318062 (+ 127us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:58.318185 (+ 123us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:58.318395 (+ 210us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:58.318543 (+ 148us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:58.318600 (+ 57us) write_op.cc:312] APPLY: finished
0812 19:26:58.318834 (+ 234us) log.cc:842] Serialized 23 byte log entry
0812 19:26:58.319591 (+ 757us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.319662 (+ 71us) write_op.cc:454] Released schema lock
0812 19:26:58.319715 (+ 53us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:58.321043 (+ 1328us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.321096 (+ 53us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":258453248,"child_traces":[["op",{"apply.queue_time_us":2600,"apply.run_cpu_time_us":2070,"apply.run_wall_time_us":3630,"num_ops":1,"prepare.queue_time_us":353459,"prepare.run_cpu_time_us":2248,"prepare.run_wall_time_us":98458,"replication_time_us":90270}]]}
I20260812 19:26:58.528947 7957 rpcz_store.cc:276] 0812 19:26:57.444945 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.724570 (+279625us) service_pool.cc:227] Handling call
0812 19:26:57.761757 (+ 37187us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:57.786368 (+ 24611us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:26:57.786570 (+ 202us) catalog_manager.cc:2761] Locking tablets
0812 19:26:57.787185 (+ 615us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:26:58.296090 (+508905us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:26:58.296424 (+ 334us) catalog_manager.cc:2809] Committing in-memory state
0812 19:26:58.296577 (+ 153us) catalog_manager.cc:2813] Aborting table tasks
0812 19:26:58.528467 (+231890us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:58.108773 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:58.109225 (+ 452us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:58.109263 (+ 38us) write_op.cc:435] Acquired schema lock
0812 19:26:58.109275 (+ 12us) tablet.cc:660] Decoding operations
0812 19:26:58.109642 (+ 367us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:58.109689 (+ 47us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:58.109710 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:58.110108 (+ 398us) tablet.cc:699] Row locks acquired
0812 19:26:58.110132 (+ 24us) write_op.cc:260] PREPARE: finished
0812 19:26:58.110271 (+ 139us) write_op.cc:270] Start()
0812 19:26:58.110372 (+ 101us) write_op.cc:276] Timestamp: P: 1786562818110196 usec, L: 0
0812 19:26:58.110389 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:26:58.172867 (+ 62478us) log.cc:842] Serialized 731 byte log entry
0812 19:26:58.175365 (+ 2498us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64471 00007f05eeedb198 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9 00007f05ef340ab1 00007f05ef33fdad 0000000000580784 00000000005805b9
0812 19:26:58.280744 (+105379us) op_driver.cc:444] REPLICATION: finished
0812 19:26:58.290326 (+ 9582us) write_op.cc:301] APPLY: starting
0812 19:26:58.290395 (+ 69us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:58.290892 (+ 497us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:58.290912 (+ 20us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:58.291431 (+ 519us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:58.294259 (+ 2828us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:58.294367 (+ 108us) write_op.cc:312] APPLY: finished
0812 19:26:58.294712 (+ 345us) log.cc:842] Serialized 29 byte log entry
0812 19:26:58.295578 (+ 866us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.295732 (+ 154us) write_op.cc:454] Released schema lock
0812 19:26:58.295807 (+ 75us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:58.312530 (+ 16723us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.312600 (+ 70us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":9229,"apply.run_cpu_time_us":3181,"apply.run_wall_time_us":22664,"mutex_wait_us":8631,"num_ops":2,"prepare.queue_time_us":319163,"prepare.run_cpu_time_us":4469,"prepare.run_wall_time_us":66786,"raft.queue_time_us":326,"raft.run_cpu_time_us":1440,"raft.run_wall_time_us":35785,"replication_time_us":170164,"spinlock_wait_cycles":142331264}]]}
I20260812 19:26:58.508430 9084 tablet.cc:1722] T 538d05c5883d4575b8eb5d42dfb3c246 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:26:58.564869 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet da5f9e7431654d5fbae5d554c6f14569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:58.476039 8354 raft_consensus.cc:2454] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
W20260812 19:26:58.512148 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 26) took 1236 ms (client timeout 1000 ms). Trace:
W20260812 19:26:58.576393 7960 rpcz_store.cc:269] 0812 19:26:57.275599 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.275721 (+ 122us) service_pool.cc:227] Handling call
0812 19:26:58.512058 (+1236337us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:57.729039 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:57.729446 (+ 407us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:57.729469 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:26:57.729481 (+ 12us) tablet.cc:660] Decoding operations
0812 19:26:57.730037 (+ 556us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:57.730078 (+ 41us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:57.730101 (+ 23us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:57.730248 (+ 147us) tablet.cc:699] Row locks acquired
0812 19:26:57.730261 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:57.730429 (+ 168us) write_op.cc:270] Start()
0812 19:26:57.730513 (+ 84us) write_op.cc:276] Timestamp: P: 1786562817730351 usec, L: 0
0812 19:26:57.730529 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:26:57.838886 (+108357us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400022018. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05efc070c4 00007f05eeeb34f9 00007f05eee6ef91 00007f05eee6ec6a 00007f05eeedacd5 00007f05eeedb179 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9
0812 19:26:57.839260 (+ 374us) log.cc:842] Serialized 533 byte log entry
0812 19:26:57.845364 (+ 6104us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b5400021fa0. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eee6f028 00007f05eee6ec6a 00007f05eeedacd5 00007f05eeedb179 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9 00007f05ef340ab1
0812 19:26:58.140102 (+294738us) op_driver.cc:444] REPLICATION: finished
0812 19:26:58.140624 (+ 522us) write_op.cc:301] APPLY: starting
0812 19:26:58.140763 (+ 139us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:58.140934 (+ 171us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:58.140962 (+ 28us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:58.141362 (+ 400us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:58.141616 (+ 254us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:58.141702 (+ 86us) write_op.cc:312] APPLY: finished
0812 19:26:58.142020 (+ 318us) log.cc:842] Serialized 23 byte log entry
0812 19:26:58.142997 (+ 977us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.143121 (+ 124us) write_op.cc:454] Released schema lock
0812 19:26:58.143176 (+ 55us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:58.165653 (+ 22477us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.165725 (+ 72us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":285,"apply.run_cpu_time_us":2533,"apply.run_wall_time_us":25381,"num_ops":1,"prepare.queue_time_us":729,"prepare.run_cpu_time_us":28931,"prepare.run_wall_time_us":379638,"raft.queue_time_us":73442,"raft.run_cpu_time_us":699,"raft.run_wall_time_us":700,"replication_time_us":409464,"spinlock_wait_cycles":259379328,"thread_start_us":232763,"threads_started":1}]]}
W20260812 19:26:58.581898 7948 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 329133us
W20260812 19:26:58.582659 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet a1bd8f6905c24ae19c3370246028f7fd because the tablet was not found. No further retry: Not found: Tablet not found: a1bd8f6905c24ae19c3370246028f7fd
W20260812 19:26:58.583482 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet a49e46c8ba704680bf12423854883b55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a49e46c8ba704680bf12423854883b55 already in progress: creating tablet
W20260812 19:26:58.584175 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 650cd08798724b6cb5f7026cd0631b65 because the tablet was not found. No further retry: Not found: Tablet not found: 650cd08798724b6cb5f7026cd0631b65
I20260812 19:26:58.584939 9037 raft_consensus.cc:2229] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:58.591084 9037 raft_consensus.cc:2258] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:58.593245 8352 raft_consensus.cc:2454] T d49351be8d2a40109d88b54db11c4489 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:58.598492 9037 ts_tablet_manager.cc:1905] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:58.604880 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29436abddcab4a46adb5aa0c54f45389" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:58.606652 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaaf04a85946447aa43873e3568aa3a3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:58.608144 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da5f9e7431654d5fbae5d554c6f14569" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:58.608716 8446 consensus_peers.cc:487] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 77445461e7f24c1e80bedb96b2af5daf. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:58.610559 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet da5f9e7431654d5fbae5d554c6f14569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:26:58.527901 8443 leader_election.cc:341] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd
W20260812 19:26:58.618065 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 31) took 1168 ms (client timeout 1000 ms). Trace:
W20260812 19:26:58.619091 7956 rpcz_store.cc:269] 0812 19:26:57.449213 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.545687 (+ 96474us) service_pool.cc:227] Handling call
0812 19:26:57.707110 (+161423us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:58.617991 (+910881us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":15,"spinlock_wait_cycles":348865920}
W20260812 19:26:58.610003 8278 leader_election.cc:341] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.625828 8278 leader_election.cc:302] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:26:58.626968 8278 leader_election.cc:341] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.627337 8278 leader_election.cc:302] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:58.614756 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:58.630620 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_cff1f67e93a94ddf996036b7f50622ad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:58.631265 9055 raft_consensus.cc:2726] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:58.632272 9055 raft_consensus.cc:2726] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:58.633638 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cff1f67e93a94ddf996036b7f50622ad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:58.641966 7960 master_service.cc:946] ReplaceTablet: received request to replace tablet 68583d63475a495ca97f3221825622e2 from {username='slave'} at 127.0.0.1:46888
W20260812 19:26:58.660941 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 138897us
I20260812 19:26:58.634032 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 5f73e97db5954612ab9dfa21bc435efd (table default.Table_cb47cf36fb124675bbc53c97d2faecd9 [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]) successfully deleted
I20260812 19:26:58.619247 8627 tablet_bootstrap.cc:654] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:26:58.676448 9110 log.cc:924] Time spent T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.068s user 0.000s sys 0.001s
I20260812 19:26:58.634369 7962 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:26:58.561683 8511 rpcz_store.cc:276] 0812 19:26:56.784317 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.789961 (+ 5644us) service_pool.cc:227] Handling call
0812 19:26:56.805033 (+ 15072us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:26:57.895403 (+1090370us) spinlock_profiling.cc:243] Waited 9.27 ms on lock 0x7b48000036d8. stack: 00007f5d9637a033 00007f5d96379f30 00007f5d95efb534 00000000004db2b4 00000000004db249 00007f5d9e2377f1 00007f5d9e22e8e7 00007f5d9e22e77a 00007f5d9e32295f 00007f5d9e322627 00007f5d9e336b2c 00007f5d9e336ad8 00007f5d9e336a58 00007f5d9e336a13 00007f5d9e335cbc 00007f5d9d72e0e6
0812 19:26:57.914808 (+ 19405us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:26:57.914842 (+ 34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:26:57.932864 (+ 18022us) log.cc:842] Serialized 26 byte log entry
0812 19:26:58.086238 (+153374us) raft_consensus.cc:1631] Marking committed up to 1
0812 19:26:58.545140 (+458902us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b1800049de0. stack: 00007f5d9637a033 00007f5d96379f30 00007f5d95efb534 00000000004db2b4 00000000004db249 00007f5d9f1e68b1 00007f5d9f1f3661 00007f5d9d11982c 00007f5d9638e9dc 0000000000570829 00007f5d963ab8bb 00007f5d963a9cbf 00007f5d963a9155 00007f5d9d718167 00007f5d9d2ff807 00007f5d9d30ef0f
0812 19:26:58.545439 (+ 299us) log.cc:842] Serialized 14 byte log entry
0812 19:26:58.546634 (+ 1195us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:26:58.546796 (+ 162us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:26:58.546867 (+ 71us) raft_consensus.cc:1671] finished
0812 19:26:58.546876 (+ 9us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:26:58.547086 (+ 210us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":434491,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":3112,"raft.queue_time_us":3936,"raft.run_cpu_time_us":2122,"raft.run_wall_time_us":98966,"spinlock_wait_cycles":28910720,"thread_start_us":588575,"threads_started":2,"wal-append.queue_time_us":148436}
W20260812 19:26:58.692235 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 65147.5us
I20260812 19:26:58.693269 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 77445461e7f24c1e80bedb96b2af5daf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:26:58.696026 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 77445461e7f24c1e80bedb96b2af5daf because the tablet was not found. No further retry: Not found: Tablet not found: 77445461e7f24c1e80bedb96b2af5daf
I20260812 19:26:58.697403 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 017b6bfef5f44da0866917e04e2db072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.699512 8625 tablet_replica.cc:330] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:58.700228 8625 raft_consensus.cc:2229] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:58.700664 8625 raft_consensus.cc:2258] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:58.702702 8625 ts_tablet_manager.cc:1905] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:58.690019 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_848e8c259ba3498d9a99ca7a371c2e2d"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:58.710857 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_848e8c259ba3498d9a99ca7a371c2e2d in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:58.710929 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.711968 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 756557a37a924bcf9d7c0743beed6a9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.714383 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.715649 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.717077 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet da5f9e7431654d5fbae5d554c6f14569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.720403 8623 tablet_bootstrap.cc:492] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:58.720816 8623 ts_tablet_manager.cc:1397] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.412s user 0.022s sys 0.001s
I20260812 19:26:58.736234 8636 tablet_bootstrap.cc:654] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:58.740218 8108 leader_election.cc:302] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:58.743186 9049 raft_consensus.cc:2781] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:58.743911 9049 raft_consensus.cc:686] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:58.743603 8108 leader_election.cc:302] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:26:58.745333 9049 consensus_queue.cc:237] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.748978 9095 raft_consensus.cc:2781] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:58.749958 9095 raft_consensus.cc:686] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:58.751550 9095 consensus_queue.cc:237] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.784018 9115 tablet.cc:1722] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260812 19:26:58.791054 8278 leader_election.cc:341] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:58.791769 8278 leader_election.cc:302] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:58.793607 9127 raft_consensus.cc:2726] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:58.802644 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 968eb13e27ea4f93a45aad17110b0ee4 consensus state has no leader
I20260812 19:26:58.803347 7959 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 168) took 1350 ms. Trace:
I20260812 19:26:58.805003 7953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 863e7ca808f54a989b3372aa4bfe361e
I20260812 19:26:58.806720 7953 catalog_manager.cc:6565] ReplaceTablet: tablet 863e7ca808f54a989b3372aa4bfe361e deleted and replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728
I20260812 19:26:58.723838 8623 raft_consensus.cc:348] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.809005 8623 raft_consensus.cc:374] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:58.809966 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:58.803733 7959 rpcz_store.cc:276] 0812 19:26:57.453312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.780728 (+327416us) service_pool.cc:227] Handling call
0812 19:26:57.854163 (+ 73435us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf7d6 00007f05ee9f5634 00007f05ee9f55c2 00007f05ee9f54f1 00007f05ee9f546c 00007f05ee9f4722 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:57.854911 (+ 748us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:57.856087 (+ 1176us) catalog_manager.cc:3616] Apply alter schema
0812 19:26:57.885063 (+ 28976us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:26:57.892500 (+ 7437us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:26:58.801928 (+909428us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:26:58.803205 (+ 1277us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:58.321616 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:58.321961 (+ 345us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:58.321984 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:26:58.321997 (+ 13us) tablet.cc:660] Decoding operations
0812 19:26:58.322232 (+ 235us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:58.322268 (+ 36us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:58.322287 (+ 19us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:58.322485 (+ 198us) tablet.cc:699] Row locks acquired
0812 19:26:58.322498 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:58.322608 (+ 110us) write_op.cc:270] Start()
0812 19:26:58.322698 (+ 90us) write_op.cc:276] Timestamp: P: 1786562818322515 usec, L: 0
0812 19:26:58.322715 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:26:58.323333 (+ 618us) log.cc:842] Serialized 405 byte log entry
0812 19:26:58.789133 (+465800us) op_driver.cc:444] REPLICATION: finished
0812 19:26:58.790991 (+ 1858us) write_op.cc:301] APPLY: starting
0812 19:26:58.791082 (+ 91us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:58.791303 (+ 221us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:58.791461 (+ 158us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:58.791750 (+ 289us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:58.792033 (+ 283us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:58.792109 (+ 76us) write_op.cc:312] APPLY: finished
0812 19:26:58.792490 (+ 381us) log.cc:842] Serialized 23 byte log entry
0812 19:26:58.792773 (+ 283us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.792900 (+ 127us) write_op.cc:454] Released schema lock
0812 19:26:58.792971 (+ 71us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:58.793305 (+ 334us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.793357 (+ 52us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":160299904,"child_traces":[["op",{"apply.queue_time_us":1493,"apply.run_cpu_time_us":2659,"apply.run_wall_time_us":2660,"num_ops":1,"prepare.queue_time_us":427985,"prepare.run_cpu_time_us":1976,"prepare.run_wall_time_us":159974,"replication_time_us":466300}]]}
I20260812 19:26:58.815325 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 22fe32c0d82845b8a9f0c0e4d88f7d39
I20260812 19:26:58.809543 8623 raft_consensus.cc:729] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:58.819864 8623 consensus_queue.cc:260] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.821508 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:58.824563 7958 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 169) took 1004 ms. Trace:
I20260812 19:26:58.856248 9147 tablet.cc:1722] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:58.825146 7958 rpcz_store.cc:276] 0812 19:26:57.820139 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.833483 (+ 13344us) service_pool.cc:227] Handling call
0812 19:26:57.870661 (+ 37178us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf466 00007f05ee9f0b34 00007f05ee9f0ac2 00007f05ee9f09f1 00007f05ee9f096c 00007f05ee9efc22 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:57.891221 (+ 20560us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:57.891732 (+ 511us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:26:57.891862 (+ 130us) catalog_manager.cc:2761] Locking tablets
0812 19:26:57.899809 (+ 7947us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:26:58.814820 (+915011us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:26:58.815094 (+ 274us) catalog_manager.cc:2809] Committing in-memory state
0812 19:26:58.815234 (+ 140us) catalog_manager.cc:2813] Aborting table tasks
0812 19:26:58.824457 (+ 9223us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:58.481834 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:58.482313 (+ 479us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:58.482340 (+ 27us) write_op.cc:435] Acquired schema lock
0812 19:26:58.482352 (+ 12us) tablet.cc:660] Decoding operations
0812 19:26:58.483175 (+ 823us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:58.483215 (+ 40us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:58.483236 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:58.483673 (+ 437us) tablet.cc:699] Row locks acquired
0812 19:26:58.483689 (+ 16us) write_op.cc:260] PREPARE: finished
0812 19:26:58.483805 (+ 116us) write_op.cc:270] Start()
0812 19:26:58.504303 (+ 20498us) write_op.cc:276] Timestamp: P: 1786562818483699 usec, L: 0
0812 19:26:58.504369 (+ 66us) op_driver.cc:331] REPLICATION: starting
0812 19:26:58.505071 (+ 702us) log.cc:842] Serialized 731 byte log entry
0812 19:26:58.789905 (+284834us) op_driver.cc:444] REPLICATION: finished
0812 19:26:58.793897 (+ 3992us) write_op.cc:301] APPLY: starting
0812 19:26:58.793973 (+ 76us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:58.794194 (+ 221us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:58.794448 (+ 254us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:58.795004 (+ 556us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:58.795306 (+ 302us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:58.795429 (+ 123us) write_op.cc:312] APPLY: finished
0812 19:26:58.795740 (+ 311us) log.cc:842] Serialized 29 byte log entry
0812 19:26:58.795995 (+ 255us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.796126 (+ 131us) write_op.cc:454] Released schema lock
0812 19:26:58.796168 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:58.817585 (+ 21417us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:58.817645 (+ 60us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7176,"spinlock_wait_cycles":82824576,"child_traces":[["op",{"apply.queue_time_us":3717,"apply.run_cpu_time_us":3138,"apply.run_wall_time_us":24054,"num_ops":2,"prepare.queue_time_us":580131,"prepare.run_cpu_time_us":2554,"prepare.run_wall_time_us":24889,"replication_time_us":285181}]]}
I20260812 19:26:58.760164 8933 ts_tablet_manager.cc:1918] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:58.862006 8933 log.cc:1196] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/b961a688b260424499bef8e6bf62734f
I20260812 19:26:58.863481 8933 ts_tablet_manager.cc:1939] T b961a688b260424499bef8e6bf62734f P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:58.865854 8493 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:58.867170 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 103) took 3268 ms. Trace:
I20260812 19:26:58.878962 7960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 68583d63475a495ca97f3221825622e2
I20260812 19:26:58.882690 7960 catalog_manager.cc:6565] ReplaceTablet: tablet 68583d63475a495ca97f3221825622e2 deleted and replaced by tablet bc8ae6adf7b64a468112753c2831ac87
I20260812 19:26:58.884717 9135 raft_consensus.cc:482] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:58.885872 9135 raft_consensus.cc:504] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:58.886411 9140 consensus_queue.cc:1035] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:58.898345 9135 leader_election.cc:288] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:58.906101 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.908020 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.912397 8623 ts_tablet_manager.cc:1428] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.191s user 0.010s sys 0.002s
I20260812 19:26:58.915654 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2815136dc6074bab9bcf3a0e4a93fdaa" } modify_external_catalogs: true
I20260812 19:26:58.918694 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d9c9480ccb5e4bfd8e04c8c1060bd76a" } new_table_name: "default.Table_df6e7bbfeab2475e99f37f8653d5e8e1" modify_external_catalogs: true
I20260812 19:26:58.916312 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2815136dc6074bab9bcf3a0e4a93fdaa" } modify_external_catalogs: true
I20260812 19:26:58.925467 7953 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:26:58.868942 8485 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:58.881042 8493 tablet_service.cc:1514] Processing DeleteTablet for tablet 68583d63475a495ca97f3221825622e2 with delete_type TABLET_DATA_DELETED (replaced by tablet bc8ae6adf7b64a468112753c2831ac87) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:58.946621 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 68583d63475a495ca97f3221825622e2 with delete_type TABLET_DATA_DELETED (replaced by tablet bc8ae6adf7b64a468112753c2831ac87) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:58.947826 8623 tablet_bootstrap.cc:492] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:58.952412 8933 rpcz_store.cc:276] 0812 19:26:55.599096 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:55.599434 (+ 338us) service_pool.cc:227] Handling call
0812 19:26:57.170378 (+1570944us) ts_tablet_manager.cc:1145] Deleting tablet b961a688b260424499bef8e6bf62734f
0812 19:26:57.170429 (+ 51us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:58.562082 (+1391653us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:58.759900 (+197818us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:58.867108 (+107208us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1535033}
I20260812 19:26:58.954823 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet b961a688b260424499bef8e6bf62734f (table default.Table_089b7ab1b51d425788a8678f7d714ed6 [id=8ec4f22b4fa1428bba045191d2a9d169]) successfully deleted
I20260812 19:26:58.965812 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 104) took 3339 ms. Trace:
I20260812 19:26:58.966471 8933 rpcz_store.cc:276] 0812 19:26:55.626720 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:55.626952 (+ 232us) service_pool.cc:227] Handling call
0812 19:26:58.965286 (+3338334us) ts_tablet_manager.cc:1145] Deleting tablet 5bfebac9602f494eb19772589992f888
0812 19:26:58.965352 (+ 66us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:58.965709 (+ 357us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3329724}
I20260812 19:26:58.968853 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 111) took 2675 ms. Trace:
W20260812 19:26:58.969447 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 5bfebac9602f494eb19772589992f888 because the tablet was not found. No further retry: Not found: Tablet not found: 5bfebac9602f494eb19772589992f888
W20260812 19:26:58.977042 8107 consensus_peers.cc:487] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:58.979084 8625 ts_tablet_manager.cc:1918] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:58.975122 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:58.982555 8933 rpcz_store.cc:276] 0812 19:26:56.293724 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.393024 (+ 99300us) service_pool.cc:227] Handling call
0812 19:26:58.968459 (+2575435us) ts_tablet_manager.cc:1145] Deleting tablet bc5c4ef0441c49fca31b2fc8a2c9abd4
0812 19:26:58.968496 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:58.968759 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2574810}
W20260812 19:26:58.991940 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 already in progress: creating tablet
I20260812 19:26:58.993474 8625 log.cc:1196] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/017b6bfef5f44da0866917e04e2db072
I20260812 19:26:58.996788 8625 ts_tablet_manager.cc:1939] T 017b6bfef5f44da0866917e04e2db072 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:58.996815 8627 tablet_bootstrap.cc:492] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:58.997390 8627 ts_tablet_manager.cc:1397] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.452s user 0.015s sys 0.013s
W20260812 19:26:59.001478 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f57f252b520945328fdaaa9adef593a1 consensus state has no leader
I20260812 19:26:59.003026 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 017b6bfef5f44da0866917e04e2db072 (table default.Table_61a5cdb267bc48488c3252251f1e139a [id=88cdc52eec7c44d992f08f4c170a5489]) successfully deleted
I20260812 19:26:59.003551 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet 68583d63475a495ca97f3221825622e2 with delete_type TABLET_DATA_DELETED (replaced by tablet bc8ae6adf7b64a468112753c2831ac87) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:59.022058 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 118) took 2526 ms. Trace:
I20260812 19:26:59.022549 8933 rpcz_store.cc:276] 0812 19:26:56.495617 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:56.495900 (+ 283us) service_pool.cc:227] Handling call
0812 19:26:59.021673 (+2525773us) ts_tablet_manager.cc:1145] Deleting tablet 3740799e07f94fe981d395ef8c3d7973
0812 19:26:59.021728 (+ 55us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.021994 (+ 266us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2496744}
W20260812 19:26:59.023965 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 3740799e07f94fe981d395ef8c3d7973 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 3740799e07f94fe981d395ef8c3d7973 already in progress: creating tablet
I20260812 19:26:59.025089 8933 tablet_replica.cc:330] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:59.025758 8625 tablet_replica.cc:330] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:59.029129 8636 tablet_bootstrap.cc:492] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:59.038781 8636 ts_tablet_manager.cc:1397] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.629s user 0.014s sys 0.013s
I20260812 19:26:59.039364 8625 raft_consensus.cc:2229] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:59.039855 8625 raft_consensus.cc:2258] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.045595 8933 raft_consensus.cc:2229] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:59.047855 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:59.049913 8354 raft_consensus.cc:2454] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:26:59.048825 8108 consensus_peers.cc:487] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eec275b2131d4848ae120d8a841a1cae. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:59.059710 8108 leader_election.cc:302] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:59.062490 8933 raft_consensus.cc:2258] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.064944 8933 ts_tablet_manager.cc:1905] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:59.057248 9115 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:44966 (request call id 134) took 1107 ms. Trace:
I20260812 19:26:59.070788 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d861fc3b700e405facd2ca9375bed373" } new_table_name: "default.Table_72b6557e0f2d486f998ff2b1f7740b53" modify_external_catalogs: true
I20260812 19:26:59.075362 9095 raft_consensus.cc:2781] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:26:59.031502 8623 tablet_bootstrap.cc:654] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.075904 9095 raft_consensus.cc:482] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:26:59.078063 9154 tablet.cc:1722] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:59.079707 7957 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_309d353d589c44c5af752d0b6d404dbd" } modify_external_catalogs: true
I20260812 19:26:59.059592 8636 raft_consensus.cc:348] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.080313 8636 raft_consensus.cc:374] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:59.080334 7957 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_309d353d589c44c5af752d0b6d404dbd" } modify_external_catalogs: true
I20260812 19:26:59.080653 8636 raft_consensus.cc:729] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:59.082619 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_071cfa8f627d4f2480821e78e17fce43"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:59.087870 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_711ff99c0d184bbd8214b29510d407cc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:59.089425 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_711ff99c0d184bbd8214b29510d407cc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:59.088829 8636 consensus_queue.cc:260] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:59.084034 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_071cfa8f627d4f2480821e78e17fce43 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:59.076229 8625 ts_tablet_manager.cc:1905] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:59.068387 9115 rpcz_store.cc:276] 0812 19:26:57.949522 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.950054 (+ 532us) service_pool.cc:227] Handling call
0812 19:26:59.057146 (+1107092us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:57.952959 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0812 19:26:57.953669 (+ 710us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0812 19:26:57.953705 (+ 36us) alter_schema_op.cc:65] Acquired schema lock
0812 19:26:57.953806 (+ 101us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0812 19:26:57.954010 (+ 204us) alter_schema_op.cc:126] START. Timestamp: 1786562817952944
0812 19:26:57.954036 (+ 26us) op_driver.cc:331] REPLICATION: starting
0812 19:26:57.955228 (+ 1192us) log.cc:842] Serialized 173 byte log entry
0812 19:26:58.577175 (+621947us) spinlock_profiling.cc:243] Waited 32.1 ms on lock 0x7b18000d0000. stack: 00007f5d9637a033 00007f5d96379f30 00007f5d95efb534 00000000004db2b4 00000000004db249 00007f5d9f1e68b1 00007f5d9f1f3661 00007f5d963ac638 00007f5d963afb11 00007f5d963afac9 00007f5d963afa59 00007f5d963afa21 00007f5d963aed1d 0000000000580784 00000000005805b9 00007f5d9638edc6
0812 19:26:58.779772 (+202597us) op_driver.cc:444] REPLICATION: finished
0812 19:26:58.780396 (+ 624us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0812 19:26:58.787235 (+ 6839us) log.cc:842] Serialized 5 byte log entry
0812 19:26:59.012902 (+225667us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.051697 (+ 38795us) log.cc:842] Serialized 14 byte log entry
0812 19:26:59.052776 (+ 1079us) alter_schema_op.cc:71] Released schema lock
0812 19:26:59.052812 (+ 36us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":156,"mutex_wait_us":18841,"prepare.queue_time_us":215,"prepare.run_cpu_time_us":31968,"prepare.run_wall_time_us":511046,"raft.queue_time_us":50271,"raft.run_cpu_time_us":24,"raft.run_wall_time_us":26,"replication_time_us":825568,"spinlock_wait_cycles":73935104,"thread_start_us":466662,"threads_started":1,"wal-append.queue_time_us":649510}]]}
W20260812 19:26:59.093873 8107 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 114148us
I20260812 19:26:59.073118 8627 raft_consensus.cc:348] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.104869 8627 raft_consensus.cc:374] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:59.105140 8627 raft_consensus.cc:729] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:59.105974 8627 consensus_queue.cc:260] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.113334 9037 ts_tablet_manager.cc:1918] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:59.106500 8636 ts_tablet_manager.cc:1428] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.067s user 0.009s sys 0.000s
W20260812 19:26:59.118710 8107 leader_election.cc:341] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.076481 9095 raft_consensus.cc:3037] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:59.132592 9037 log.cc:1196] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/453a403d1c0b4b5c8dcd9b93c7cc9ea4
I20260812 19:26:59.134408 9037 ts_tablet_manager.cc:1939] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:59.118141 8627 ts_tablet_manager.cc:1428] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.120s user 0.009s sys 0.000s
I20260812 19:26:59.136628 8627 tablet_bootstrap.cc:492] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:59.151057 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 136) took 1560 ms. Trace:
I20260812 19:26:59.152936 8636 tablet_bootstrap.cc:492] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:59.134230 9159 tablet.cc:1722] T 1950030ab501429a91971f80f761a172 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:59.167339 8636 tablet_bootstrap.cc:654] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.181257 8869 raft_consensus.cc:482] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:26:59.181573 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_c30c4f84e6034b5f84410839aeafaef4 [id=97f951f5bce143dbac6324c558577701], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 968eb13e27ea4f93a45aad17110b0ee4 consensus state has no leader
I20260812 19:26:59.181638 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_fac2d883e0444e638b031f6bd0209b93"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:26:59.182112 8869 raft_consensus.cc:504] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:59.183732 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fac2d883e0444e638b031f6bd0209b93 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:59.185168 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_0c169ee9078f4bed9f0e3611083f1540"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:59.186723 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0c169ee9078f4bed9f0e3611083f1540 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:59.188582 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:26:59.190025 8869 leader_election.cc:288] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:59.191918 9095 raft_consensus.cc:504] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.151664 9037 rpcz_store.cc:276] 0812 19:26:57.590549 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.591257 (+ 708us) service_pool.cc:227] Handling call
0812 19:26:58.461244 (+869987us) ts_tablet_manager.cc:1145] Deleting tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4
0812 19:26:58.461373 (+ 129us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:58.590673 (+129300us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b5400042254. stack: 00007f865924a033 00007f8659249f30 00007f8658dcb534 00000000004db2b4 00000000004db249 00007f866014a471 00007f86601cd352 00007f86605e326c 00007f86611f0cfa 00007f8661220e10 00007f8661207e0d 00007f8661207db9 00007f8661207d49 00007f8661207d11 00007f8661206f3d 0000000000580784
0812 19:26:58.861921 (+271248us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.113033 (+251112us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.150951 (+ 37918us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":74115840,"tablet-delete.queue_time_us":869378}
I20260812 19:26:59.208102 9037 tablet_replica.cc:330] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:59.208012 8933 ts_tablet_manager.cc:1918] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:26:59.208429 8933 log.cc:1196] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/650cd08798724b6cb5f7026cd0631b65
I20260812 19:26:59.209184 8933 ts_tablet_manager.cc:1939] T 650cd08798724b6cb5f7026cd0631b65 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:59.211045 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 119) took 1971 ms. Trace:
I20260812 19:26:59.211330 8933 rpcz_store.cc:276] 0812 19:26:57.239755 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.283781 (+ 44026us) service_pool.cc:227] Handling call
0812 19:26:59.024916 (+1741135us) ts_tablet_manager.cc:1145] Deleting tablet 650cd08798724b6cb5f7026cd0631b65
0812 19:26:59.024964 (+ 48us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.168587 (+143623us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.207795 (+ 39208us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.210994 (+ 3199us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1719742}
I20260812 19:26:59.212751 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 650cd08798724b6cb5f7026cd0631b65 (table default.Table_b2cf8a30ab8d4d87883ebcf036b1cdd6 [id=207aa714585c4a20a2ccb8fc894c04b4]) successfully deleted
I20260812 19:26:59.213737 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 123) took 1406 ms. Trace:
I20260812 19:26:59.214033 8933 rpcz_store.cc:276] 0812 19:26:57.807316 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.807502 (+ 186us) service_pool.cc:227] Handling call
0812 19:26:59.213485 (+1405983us) ts_tablet_manager.cc:1145] Deleting tablet decf138a91394c939f686ff127ca7922
0812 19:26:59.213523 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.213689 (+ 166us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1405453}
W20260812 19:26:59.215128 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet decf138a91394c939f686ff127ca7922 because the tablet was not found. No further retry: Not found: Tablet not found: decf138a91394c939f686ff127ca7922
I20260812 19:26:59.216038 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 124) took 1397 ms. Trace:
I20260812 19:26:59.216351 8933 rpcz_store.cc:276] 0812 19:26:57.818216 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.818404 (+ 188us) service_pool.cc:227] Handling call
0812 19:26:59.215791 (+1397387us) ts_tablet_manager.cc:1145] Deleting tablet a1bd8f6905c24ae19c3370246028f7fd
0812 19:26:59.215829 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.215992 (+ 163us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1374192}
W20260812 19:26:59.217403 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet a1bd8f6905c24ae19c3370246028f7fd because the tablet was not found. No further retry: Not found: Tablet not found: a1bd8f6905c24ae19c3370246028f7fd
I20260812 19:26:59.218191 8933 tablet_replica.cc:330] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:59.220664 8933 raft_consensus.cc:2229] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:59.221541 8933 raft_consensus.cc:2258] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.223263 8933 ts_tablet_manager.cc:1905] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:59.228368 8443 consensus_peers.cc:487] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:59.238605 8636 tablet_bootstrap.cc:492] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:59.239149 8636 ts_tablet_manager.cc:1397] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.086s user 0.006s sys 0.005s
I20260812 19:26:59.242182 9037 raft_consensus.cc:2229] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:59.242165 8636 raft_consensus.cc:348] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.243088 8636 raft_consensus.cc:374] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:59.243340 8636 raft_consensus.cc:729] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:59.243932 8636 consensus_queue.cc:260] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:26:59.251456 8446 consensus_peers.cc:487] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:59.253422 8933 ts_tablet_manager.cc:1918] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:59.253779 8933 log.cc:1196] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/77445461e7f24c1e80bedb96b2af5daf
I20260812 19:26:59.254498 8933 ts_tablet_manager.cc:1939] T 77445461e7f24c1e80bedb96b2af5daf P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:59.257225 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 126) took 1406 ms. Trace:
I20260812 19:26:59.257529 8933 rpcz_store.cc:276] 0812 19:26:57.851152 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.852122 (+ 970us) service_pool.cc:227] Handling call
0812 19:26:59.218062 (+1365940us) ts_tablet_manager.cc:1145] Deleting tablet 77445461e7f24c1e80bedb96b2af5daf
0812 19:26:59.218097 (+ 35us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.236066 (+ 17969us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.253114 (+ 17048us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.257172 (+ 4058us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1357546}
I20260812 19:26:59.258764 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 77445461e7f24c1e80bedb96b2af5daf (table default.Table_3450db0f15ec43dfb63b86b025614242 [id=23c4b17280f540ddacaf2fe8b08715c9]) successfully deleted
I20260812 19:26:59.259752 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 125) took 1410 ms. Trace:
I20260812 19:26:59.260016 8933 rpcz_store.cc:276] 0812 19:26:57.849015 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.849557 (+ 542us) service_pool.cc:227] Handling call
0812 19:26:59.259516 (+1409959us) ts_tablet_manager.cc:1145] Deleting tablet dab1e77a362d483788ac38318df3b58a
0812 19:26:59.259554 (+ 38us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.259699 (+ 145us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1359060}
W20260812 19:26:59.261085 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet dab1e77a362d483788ac38318df3b58a because the tablet was not found. No further retry: Not found: Tablet not found: dab1e77a362d483788ac38318df3b58a
I20260812 19:26:59.262188 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 127) took 1369 ms. Trace:
I20260812 19:26:59.262538 8933 rpcz_store.cc:276] 0812 19:26:57.892804 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.892914 (+ 110us) service_pool.cc:227] Handling call
0812 19:26:59.261819 (+1368905us) ts_tablet_manager.cc:1145] Deleting tablet 14f1198fb9b646b5ae473cfbdfcd7a8d
0812 19:26:59.261912 (+ 93us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.262146 (+ 234us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1360654}
W20260812 19:26:59.263864 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14f1198fb9b646b5ae473cfbdfcd7a8d already in progress: creating tablet
I20260812 19:26:59.266781 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 (table default.Table_e13f5860d61746f4b3d9ecda0df98a09 [id=dbcf165b445f4ef8a27f2d58ac93b3d2]) successfully deleted
I20260812 19:26:59.256004 9037 raft_consensus.cc:2258] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.210793 8627 tablet_bootstrap.cc:654] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.282691 9095 leader_election.cc:288] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:59.248924 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1950030ab501429a91971f80f761a172" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:59.283658 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:26:59.284864 8446 leader_election.cc:302] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:59.285686 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:26:59.191501 9156 tablet.cc:1722] T 1950030ab501429a91971f80f761a172 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:59.288856 8869 raft_consensus.cc:2726] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:59.289539 8355 raft_consensus.cc:3037] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:59.246814 8636 ts_tablet_manager.cc:1428] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 19:26:59.299973 8636 tablet_bootstrap.cc:492] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:26:59.302490 8355 raft_consensus.cc:2454] T b7d4a12b9c14415e8449d39663296450 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:26:59.303714 8108 leader_election.cc:302] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:26:59.305094 8623 tablet_bootstrap.cc:492] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:59.305624 8623 ts_tablet_manager.cc:1397] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.358s user 0.003s sys 0.022s
W20260812 19:26:59.308620 8107 leader_election.cc:341] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:59.309763 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 544d3d74baa6477da11abbee139ee66f consensus state has no leader
I20260812 19:26:59.313555 8516 raft_consensus.cc:3037] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:26:59.310078 9140 raft_consensus.cc:2781] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:26:59.322124 8869 raft_consensus.cc:482] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:59.322950 8869 raft_consensus.cc:504] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.328635 8869 leader_election.cc:288] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:26:59.330957 8446 leader_election.cc:341] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 017b6bfef5f44da0866917e04e2db072
W20260812 19:26:59.338851 8443 leader_election.cc:341] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 017b6bfef5f44da0866917e04e2db072
I20260812 19:26:59.337087 8933 tablet_replica.cc:330] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:59.339568 8443 leader_election.cc:302] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:59.343412 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_81a4aee1bd344393bbf0378d7796280d" } new_table_name: "default.Table_903471d080324d5480b38b2b6c7aa97a" modify_external_catalogs: true
I20260812 19:26:59.346985 8933 raft_consensus.cc:2229] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:26:59.347379 9127 raft_consensus.cc:482] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:59.348058 8933 pending_rounds.cc:62] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Trying to abort 1 pending ops.
I20260812 19:26:59.348634 9127 raft_consensus.cc:504] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.348822 8623 raft_consensus.cc:348] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.350385 8623 raft_consensus.cc:374] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:59.350687 8623 raft_consensus.cc:729] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:59.351476 8623 consensus_queue.cc:260] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.321287 9140 raft_consensus.cc:686] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:26:59.355530 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd34ec17d8c4609ad979fab951c8a96" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:59.348351 8933 pending_rounds.cc:68] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761303079542784 op_type: NO_OP noop_request { }
I20260812 19:26:59.357420 8933 raft_consensus.cc:2866] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:26:59.357829 8933 raft_consensus.cc:2258] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:26:59.358101 8278 leader_election.cc:341] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.359520 9127 leader_election.cc:288] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:59.360888 8933 ts_tablet_manager.cc:1905] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:59.358270 8869 raft_consensus.cc:2726] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:59.372666 8636 tablet_bootstrap.cc:654] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.385586 9037 ts_tablet_manager.cc:1905] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:59.395954 8627 tablet_bootstrap.cc:492] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:26:59.396572 8627 ts_tablet_manager.cc:1397] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.260s user 0.007s sys 0.008s
W20260812 19:26:59.398875 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 197687us
I20260812 19:26:59.356945 9140 consensus_queue.cc:237] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.380609 8869 raft_consensus.cc:482] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:59.416733 9127 raft_consensus.cc:482] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:59.417110 8869 raft_consensus.cc:504] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.417550 9127 raft_consensus.cc:504] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.422856 9127 leader_election.cc:288] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:59.384968 8933 ts_tablet_manager.cc:1918] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:26:59.426358 8933 log.cc:1196] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/cb55b45c8db944b18d1fcc0ea92dbebd
I20260812 19:26:59.427232 8933 ts_tablet_manager.cc:1939] T cb55b45c8db944b18d1fcc0ea92dbebd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:59.428056 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:59.430121 8443 leader_election.cc:341] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 69fe5774f8dc46308954e9be54bd92b2
W20260812 19:26:59.431396 8278 leader_election.cc:341] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.431846 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 131) took 1495 ms. Trace:
I20260812 19:26:59.432075 8869 leader_election.cc:288] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:26:59.432122 8933 rpcz_store.cc:276] 0812 19:26:57.936630 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.936798 (+ 168us) service_pool.cc:227] Handling call
0812 19:26:59.336870 (+1400072us) ts_tablet_manager.cc:1145] Deleting tablet cb55b45c8db944b18d1fcc0ea92dbebd
0812 19:26:59.336928 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.375747 (+ 38819us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.384713 (+ 8966us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.430292 (+ 45579us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b5800001898. stack: 00007f5d9637a033 00007f5d96379f30 00007f5d95efb534 00000000004db2b4 00000000004db249 00007f5d961f0f11 00007f5d96374851 00007f5d96374e82 00007f5d9f2288b9 00007f5d9e25c5d8 00007f5d9e320e42 00007f5d9e350e10 00007f5d9e337e0d 00007f5d9e337db9 00007f5d9e337d49 00007f5d9e337d11
0812 19:26:59.431789 (+ 1497us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4255616,"tablet-delete.queue_time_us":1358116}
I20260812 19:26:59.433595 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet cb55b45c8db944b18d1fcc0ea92dbebd (table default.Table_ef547861981d429baacbb9286c8fc629 [id=27b6a83f08704d199cbb25ab55bc634b]) successfully deleted
I20260812 19:26:59.436354 8933 tablet_replica.cc:330] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:59.437100 8623 ts_tablet_manager.cc:1428] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.131s user 0.009s sys 0.001s
I20260812 19:26:59.437296 8933 raft_consensus.cc:2229] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:59.438720 8933 raft_consensus.cc:2258] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.438817 8623 tablet_bootstrap.cc:492] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:59.440620 8933 ts_tablet_manager.cc:1905] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:59.446519 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd34ec17d8c4609ad979fab951c8a96" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:59.446254 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:59.454301 8446 leader_election.cc:341] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 69fe5774f8dc46308954e9be54bd92b2
I20260812 19:26:59.454698 8446 leader_election.cc:302] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:26:59.464648 8281 leader_election.cc:341] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.465198 8281 leader_election.cc:302] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:26:59.466347 8281 leader_election.cc:341] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.466701 8281 leader_election.cc:302] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:59.468474 8869 raft_consensus.cc:2726] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:59.478828 9115 tablet.cc:1722] T 1950030ab501429a91971f80f761a172 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:26:59.434422 8625 ts_tablet_manager.cc:1918] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:59.486181 8625 log.cc:1196] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:26:59.487111 8625 ts_tablet_manager.cc:1939] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:59.488571 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 (table default.Table_736993619204407d83bd0619aee8a645 [id=589f397fce314ea1ad0c0e42e4943267]) successfully deleted
I20260812 19:26:59.493961 8627 raft_consensus.cc:348] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.505777 9127 raft_consensus.cc:2726] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:59.506556 9127 raft_consensus.cc:2726] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:26:59.509428 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 4f7febfc2dcc4ec7a164485dbd6cac8b consensus state has no leader
I20260812 19:26:59.509299 8332 tablet_service.cc:1467] Processing CreateTablet for tablet a2b4ef63a53540e6be590243b1d27330 (DEFAULT_TABLE table=default.Table_7bbd6b066d084c81b9307f7db324d95f [id=f832c3b9d1784bb1b4794513d4832db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.510412 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2b4ef63a53540e6be590243b1d27330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.512651 8625 tablet_replica.cc:330] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:26:59.514038 8625 raft_consensus.cc:2229] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:59.514791 8625 raft_consensus.cc:2258] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.517829 8323 tablet_service.cc:1467] Processing CreateTablet for tablet e67867b6cb864b47ba7b115e12cddb17 (DEFAULT_TABLE table=default.Table_604fc9ff0c7e495ab501f9da7792f4d7 [id=7d0fca66d4be45bab2673ba518b22f2e]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:26:59.518318 8107 consensus_peers.cc:487] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:59.518085 8487 tablet_service.cc:1467] Processing CreateTablet for tablet a2b4ef63a53540e6be590243b1d27330 (DEFAULT_TABLE table=default.Table_7bbd6b066d084c81b9307f7db324d95f [id=f832c3b9d1784bb1b4794513d4832db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.519001 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67867b6cb864b47ba7b115e12cddb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.519300 8487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2b4ef63a53540e6be590243b1d27330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.521828 7954 catalog_manager.cc:5495] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:26:59.523175 7954 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:26:59.529033 8625 ts_tablet_manager.cc:1905] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:26:59.529006 7959 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_604fc9ff0c7e495ab501f9da7792f4d7" } new_table_name: "default.Table_45af8c6f1cfb45d6bb659c47a4e00169" modify_external_catalogs: true
W20260812 19:26:59.532673 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 66338.7us
I20260812 19:26:59.533496 8482 tablet_service.cc:1467] Processing CreateTablet for tablet e67867b6cb864b47ba7b115e12cddb17 (DEFAULT_TABLE table=default.Table_604fc9ff0c7e495ab501f9da7792f4d7 [id=7d0fca66d4be45bab2673ba518b22f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.534605 8482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67867b6cb864b47ba7b115e12cddb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.539088 8483 tablet_service.cc:1467] Processing CreateTablet for tablet b07f7215876740519164e7d7e08302bd (DEFAULT_TABLE table=default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.540433 8623 tablet_bootstrap.cc:654] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.541205 8326 tablet_service.cc:1467] Processing CreateTablet for tablet b07f7215876740519164e7d7e08302bd (DEFAULT_TABLE table=default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.542325 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b07f7215876740519164e7d7e08302bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.552762 8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b07f7215876740519164e7d7e08302bd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:59.557251 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 61332.7us
I20260812 19:26:59.559551 8158 tablet_service.cc:1467] Processing CreateTablet for tablet a2b4ef63a53540e6be590243b1d27330 (DEFAULT_TABLE table=default.Table_7bbd6b066d084c81b9307f7db324d95f [id=f832c3b9d1784bb1b4794513d4832db8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.560839 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2b4ef63a53540e6be590243b1d27330. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.576220 7958 master_service.cc:946] ReplaceTablet: received request to replace tablet 5bce01fd81f04f23a8cddc3a7b5eae8f from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:59.576617 8322 tablet_service.cc:1467] Processing CreateTablet for tablet bdc25879cf7c434b91591a7c7382cdb0 (DEFAULT_TABLE table=default.Table_309d353d589c44c5af752d0b6d404dbd [id=be942a02709d4ef89fbb2a0fa637d1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.577307 7952 master_service.cc:946] ReplaceTablet: received request to replace tablet 249da5c0bd73498bbfc8f41e7513a9d4 from {username='slave'} at 127.0.0.1:46888
I20260812 19:26:59.577777 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdc25879cf7c434b91591a7c7382cdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.579435 8933 ts_tablet_manager.cc:1918] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:59.579294 8485 tablet_service.cc:1467] Processing CreateTablet for tablet bdc25879cf7c434b91591a7c7382cdb0 (DEFAULT_TABLE table=default.Table_309d353d589c44c5af752d0b6d404dbd [id=be942a02709d4ef89fbb2a0fa637d1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.579787 8933 log.cc:1196] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/5f73e97db5954612ab9dfa21bc435efd
I20260812 19:26:59.580439 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdc25879cf7c434b91591a7c7382cdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.589684 9049 consensus_queue.cc:1035] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:26:59.596413 8933 ts_tablet_manager.cc:1939] T 5f73e97db5954612ab9dfa21bc435efd P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:26:59.597381 8152 tablet_service.cc:1467] Processing CreateTablet for tablet b07f7215876740519164e7d7e08302bd (DEFAULT_TABLE table=default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.598526 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b07f7215876740519164e7d7e08302bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.598589 8155 tablet_service.cc:1467] Processing CreateTablet for tablet e67867b6cb864b47ba7b115e12cddb17 (DEFAULT_TABLE table=default.Table_604fc9ff0c7e495ab501f9da7792f4d7 [id=7d0fca66d4be45bab2673ba518b22f2e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.599843 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e67867b6cb864b47ba7b115e12cddb17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.613904 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 130) took 1702 ms. Trace:
I20260812 19:26:59.623728 8154 tablet_service.cc:1467] Processing CreateTablet for tablet bdc25879cf7c434b91591a7c7382cdb0 (DEFAULT_TABLE table=default.Table_309d353d589c44c5af752d0b6d404dbd [id=be942a02709d4ef89fbb2a0fa637d1f9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.625033 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdc25879cf7c434b91591a7c7382cdb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.614305 8933 rpcz_store.cc:276] 0812 19:26:57.911514 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.911736 (+ 222us) service_pool.cc:227] Handling call
0812 19:26:59.436174 (+1524438us) ts_tablet_manager.cc:1145] Deleting tablet 5f73e97db5954612ab9dfa21bc435efd
0812 19:26:59.436213 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.537094 (+100881us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.579227 (+ 42133us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.613813 (+ 34586us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1457224}
I20260812 19:26:59.629637 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 5f73e97db5954612ab9dfa21bc435efd (table default.Table_cb47cf36fb124675bbc53c97d2faecd9 [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]) successfully deleted
I20260812 19:26:59.635176 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 135) took 1528 ms. Trace:
I20260812 19:26:59.617853 9171 raft_consensus.cc:482] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:59.636183 9171 raft_consensus.cc:504] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.524138 7954 catalog_manager.cc:5495] T 11eb974d35ba42418292e5a9fa82e331 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:26:59.638679 8623 tablet_bootstrap.cc:492] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:26:59.638833 7954 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 1950030ab501429a91971f80f761a172 (table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]). Expected version 1 got 0
I20260812 19:26:59.639873 7954 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:26:59.640836 7954 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:26:59.644333 9171 leader_election.cc:288] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:59.645411 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbafc01c482b493a981aed31ce112885" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:26:59.645763 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbafc01c482b493a981aed31ce112885" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:26:59.646780 8281 leader_election.cc:341] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:26:59.647184 8278 leader_election.cc:341] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.647614 8278 leader_election.cc:302] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:59.648346 9171 raft_consensus.cc:2726] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:59.648448 8328 tablet_service.cc:1467] Processing CreateTablet for tablet 9bdb7cce923c4ed98e400c121b6237ba (DEFAULT_TABLE table=default.Table_c0342c9c603b4c74983e00d14709ee8b [id=ea7ebd72106345978b7ccd28e8599c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.649560 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bdb7cce923c4ed98e400c121b6237ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.652571 8482 tablet_service.cc:1467] Processing CreateTablet for tablet 9bdb7cce923c4ed98e400c121b6237ba (DEFAULT_TABLE table=default.Table_c0342c9c603b4c74983e00d14709ee8b [id=ea7ebd72106345978b7ccd28e8599c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.654887 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 9bdb7cce923c4ed98e400c121b6237ba (DEFAULT_TABLE table=default.Table_c0342c9c603b4c74983e00d14709ee8b [id=ea7ebd72106345978b7ccd28e8599c2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.494714 8627 raft_consensus.cc:374] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:59.655355 8627 raft_consensus.cc:729] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:26:59.655951 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bdb7cce923c4ed98e400c121b6237ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.656531 8482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bdb7cce923c4ed98e400c121b6237ba. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:59.665719 8107 consensus_peers.cc:487] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:59.666622 8623 ts_tablet_manager.cc:1397] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.228s user 0.008s sys 0.003s
I20260812 19:26:59.669026 8623 raft_consensus.cc:348] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.672142 8623 raft_consensus.cc:374] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:59.672546 8623 raft_consensus.cc:729] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:26:59.673267 8623 consensus_queue.cc:260] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.678424 8636 tablet_bootstrap.cc:492] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:26:59.678946 8636 ts_tablet_manager.cc:1397] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.379s user 0.024s sys 0.016s
I20260812 19:26:59.681314 8636 raft_consensus.cc:348] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:59.684639 8625 ts_tablet_manager.cc:1918] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:59.685231 8625 log.cc:1196] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/756557a37a924bcf9d7c0743beed6a9d
I20260812 19:26:59.686093 8625 ts_tablet_manager.cc:1939] T 756557a37a924bcf9d7c0743beed6a9d P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:26:59.687886 8623 ts_tablet_manager.cc:1428] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260812 19:26:59.696755 8623 tablet_bootstrap.cc:492] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:26:59.696866 8636 raft_consensus.cc:374] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:26:59.697474 8636 raft_consensus.cc:729] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:26:59.698688 8636 consensus_queue.cc:260] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:59.710242 8623 tablet_bootstrap.cc:654] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.710613 8636 ts_tablet_manager.cc:1428] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.031s user 0.005s sys 0.000s
I20260812 19:26:59.635501 8933 rpcz_store.cc:276] 0812 19:26:58.106790 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.107296 (+ 506us) service_pool.cc:227] Handling call
0812 19:26:59.634807 (+1527511us) ts_tablet_manager.cc:1145] Deleting tablet a49e46c8ba704680bf12423854883b55
0812 19:26:59.634849 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.635117 (+ 268us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1526434}
I20260812 19:26:59.656025 8627 consensus_queue.cc:260] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.716437 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 138) took 1108 ms. Trace:
I20260812 19:26:59.718086 8933 rpcz_store.cc:276] 0812 19:26:58.607973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.610433 (+ 2460us) service_pool.cc:227] Handling call
0812 19:26:59.712247 (+1101814us) ts_tablet_manager.cc:1145] Deleting tablet da5f9e7431654d5fbae5d554c6f14569
0812 19:26:59.715987 (+ 3740us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.716362 (+ 375us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1101281}
I20260812 19:26:59.730684 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 787047cca4ce4c6884ce5bd07a93f077 (DEFAULT_TABLE table=default.Table_abc701c69d604e08b2c81f972eeeb6e8 [id=6ad4b3f784244d538e0836d507969cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.731858 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787047cca4ce4c6884ce5bd07a93f077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.732476 9171 raft_consensus.cc:482] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:59.732924 9171 raft_consensus.cc:504] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:26:59.737598 8333 tablet_service.cc:1467] Processing CreateTablet for tablet b4d07516dc1c4193b4cbd68185f92891 (DEFAULT_TABLE table=default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.738597 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d07516dc1c4193b4cbd68185f92891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.740913 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 787047cca4ce4c6884ce5bd07a93f077 (DEFAULT_TABLE table=default.Table_abc701c69d604e08b2c81f972eeeb6e8 [id=6ad4b3f784244d538e0836d507969cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.741882 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787047cca4ce4c6884ce5bd07a93f077. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:26:59.748847 8108 consensus_peers.cc:487] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 453a403d1c0b4b5c8dcd9b93c7cc9ea4. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:26:59.673075 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_6c57c3ce8a2f45ec8c96d3630de76779"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:59.750195 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6c57c3ce8a2f45ec8c96d3630de76779 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:59.693681 7957 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet bdc25879cf7c434b91591a7c7382cdb0
W20260812 19:26:59.711656 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet a49e46c8ba704680bf12423854883b55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a49e46c8ba704680bf12423854883b55 already in progress: creating tablet
W20260812 19:26:59.756523 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 44901.8us
W20260812 19:26:59.758448 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet da5f9e7431654d5fbae5d554c6f14569 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5f9e7431654d5fbae5d554c6f14569 already in progress: creating tablet
W20260812 19:26:59.759245 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 already in progress: creating tablet
I20260812 19:26:59.763226 8485 tablet_service.cc:1467] Processing CreateTablet for tablet b4d07516dc1c4193b4cbd68185f92891 (DEFAULT_TABLE table=default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.764088 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet bdc25879cf7c434b91591a7c7382cdb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:59 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:59.765573 8487 tablet_service.cc:1467] Processing CreateTablet for tablet 787047cca4ce4c6884ce5bd07a93f077 (DEFAULT_TABLE table=default.Table_abc701c69d604e08b2c81f972eeeb6e8 [id=6ad4b3f784244d538e0836d507969cdc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.767086 8483 tablet_service.cc:1514] Processing DeleteTablet for tablet bdc25879cf7c434b91591a7c7382cdb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:59 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:59.774197 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet bdc25879cf7c434b91591a7c7382cdb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:59 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:59.789729 8156 tablet_service.cc:1467] Processing CreateTablet for tablet b4d07516dc1c4193b4cbd68185f92891 (DEFAULT_TABLE table=default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.791299 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d07516dc1c4193b4cbd68185f92891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.794284 9171 leader_election.cc:288] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:26:59.794456 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:26:59.795871 8281 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.807514 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 384506029b4e49639f87f6d7005fa0a9
I20260812 19:26:59.669214 9037 ts_tablet_manager.cc:1918] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:26:59.808682 9037 log.cc:1196] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/4dc5602ff1c24b6ab561389031d89885
I20260812 19:26:59.809254 7955 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 177) took 1033 ms. Trace:
I20260812 19:26:59.810355 9037 ts_tablet_manager.cc:1939] T 4dc5602ff1c24b6ab561389031d89885 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:26:59.813206 8483 tablet_service.cc:1514] Processing DeleteTablet for tablet 384506029b4e49639f87f6d7005fa0a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:58 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:26:59.809629 7955 rpcz_store.cc:276] 0812 19:26:58.776033 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.848975 (+ 72942us) service_pool.cc:227] Handling call
0812 19:26:58.915525 (+ 66550us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf466 00007f05ee9f0b34 00007f05ee9f0ac2 00007f05ee9f09f1 00007f05ee9f096c 00007f05ee9efc22 00007f05ecc9a94c 00007f05ecc99d86
0812 19:26:58.920732 (+ 5207us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:26:58.926678 (+ 5946us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:26:58.926858 (+ 180us) catalog_manager.cc:2761] Locking tablets
0812 19:26:59.506509 (+579651us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:26:59.807063 (+300554us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:26:59.807298 (+ 235us) catalog_manager.cc:2809] Committing in-memory state
0812 19:26:59.807424 (+ 126us) catalog_manager.cc:2813] Aborting table tasks
0812 19:26:59.809181 (+ 1757us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:59.555757 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:59.556088 (+ 331us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:59.556110 (+ 22us) write_op.cc:435] Acquired schema lock
0812 19:26:59.556123 (+ 13us) tablet.cc:660] Decoding operations
0812 19:26:59.556459 (+ 336us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:59.556493 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:59.556512 (+ 19us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:26:59.556761 (+ 249us) tablet.cc:699] Row locks acquired
0812 19:26:59.556774 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:59.556874 (+ 100us) write_op.cc:270] Start()
0812 19:26:59.556953 (+ 79us) write_op.cc:276] Timestamp: P: 1786562819556804 usec, L: 0
0812 19:26:59.556969 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:26:59.662231 (+105262us) log.cc:842] Serialized 737 byte log entry
0812 19:26:59.803906 (+141675us) op_driver.cc:444] REPLICATION: finished
0812 19:26:59.805284 (+ 1378us) write_op.cc:301] APPLY: starting
0812 19:26:59.805374 (+ 90us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:59.805555 (+ 181us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:59.805700 (+ 145us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:59.806017 (+ 317us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:59.806226 (+ 209us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:26:59.806278 (+ 52us) write_op.cc:312] APPLY: finished
0812 19:26:59.806485 (+ 207us) log.cc:842] Serialized 29 byte log entry
0812 19:26:59.806649 (+ 164us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:59.806718 (+ 69us) write_op.cc:454] Released schema lock
0812 19:26:59.806759 (+ 41us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":149322624,"child_traces":[["op",{"apply.queue_time_us":1127,"apply.run_cpu_time_us":2007,"apply.run_wall_time_us":9623,"num_ops":2,"prepare.queue_time_us":47690,"prepare.run_cpu_time_us":2180,"prepare.run_wall_time_us":160730,"raft.queue_time_us":1985,"raft.run_cpu_time_us":13,"raft.run_wall_time_us":14,"replication_time_us":246791}]]}
I20260812 19:26:59.815009 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 384506029b4e49639f87f6d7005fa0a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:58 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:26:59.821332 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 137) took 2230 ms. Trace:
I20260812 19:26:59.821662 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:26:59.823122 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:26:59.824199 8483 tablet_service.cc:1467] Processing CreateTablet for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b (DEFAULT_TABLE table=default.Table_903471d080324d5480b38b2b6c7aa97a [id=fbf35ce6f2d04e8f9f732a8081a08372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.850188 8933 tablet_replica.cc:330] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:26:59.851182 8933 raft_consensus.cc:2229] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:59.851789 8933 raft_consensus.cc:2258] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.852767 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b (DEFAULT_TABLE table=default.Table_903471d080324d5480b38b2b6c7aa97a [id=fbf35ce6f2d04e8f9f732a8081a08372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.853860 8869 raft_consensus.cc:482] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:26:59.854424 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.854449 8869 raft_consensus.cc:504] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:26:59.858328 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4d07516dc1c4193b4cbd68185f92891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.860595 8869 leader_election.cc:288] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:26:59.862457 8107 consensus_peers.cc:487] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:26:59.863437 8443 leader_election.cc:341] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 756557a37a924bcf9d7c0743beed6a9d
I20260812 19:26:59.864395 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 166) took 1165 ms. Trace:
W20260812 19:26:59.864825 8446 leader_election.cc:341] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 756557a37a924bcf9d7c0743beed6a9d
I20260812 19:26:59.865283 8446 leader_election.cc:302] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:26:59.863262 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:26:59.866334 8487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 787047cca4ce4c6884ce5bd07a93f077. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.867841 8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.865305 8625 rpcz_store.cc:276] 0812 19:26:58.699153 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.711851 (+ 12698us) service_pool.cc:227] Handling call
0812 19:26:59.512386 (+800535us) ts_tablet_manager.cc:1145] Deleting tablet 756557a37a924bcf9d7c0743beed6a9d
0812 19:26:59.512497 (+ 111us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.584776 (+ 72279us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.684340 (+ 99564us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.688112 (+ 3772us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":775903}
I20260812 19:26:59.825258 8627 ts_tablet_manager.cc:1428] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.428s user 0.005s sys 0.002s
I20260812 19:26:59.827845 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b (DEFAULT_TABLE table=default.Table_903471d080324d5480b38b2b6c7aa97a [id=fbf35ce6f2d04e8f9f732a8081a08372]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:26:59.880760 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:26:59.881114 8869 raft_consensus.cc:2726] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:59.881790 8636 tablet_bootstrap.cc:492] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:26:59.881891 8278 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:26:59.882248 8278 leader_election.cc:302] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:26:59.886896 9171 raft_consensus.cc:2726] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:26:59.895501 8627 tablet_bootstrap.cc:492] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:26:59.879406 9037 rpcz_store.cc:276] 0812 19:26:57.591101 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.591253 (+ 152us) service_pool.cc:227] Handling call
0812 19:26:59.207937 (+1616684us) ts_tablet_manager.cc:1145] Deleting tablet 4dc5602ff1c24b6ab561389031d89885
0812 19:26:59.207983 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.605464 (+397481us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.668975 (+ 63511us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:59.821249 (+152274us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1615750}
I20260812 19:26:59.906039 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 4dc5602ff1c24b6ab561389031d89885 (table default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]) successfully deleted
I20260812 19:26:59.909786 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 138) took 2290 ms. Trace:
I20260812 19:26:59.910244 9037 rpcz_store.cc:276] 0812 19:26:57.619561 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.619730 (+ 169us) service_pool.cc:227] Handling call
0812 19:26:59.909384 (+2289654us) ts_tablet_manager.cc:1145] Deleting tablet 14f1198fb9b646b5ae473cfbdfcd7a8d
0812 19:26:59.909436 (+ 52us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.909725 (+ 289us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2288859}
W20260812 19:26:59.911574 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 14f1198fb9b646b5ae473cfbdfcd7a8d because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14f1198fb9b646b5ae473cfbdfcd7a8d already in progress: creating tablet
I20260812 19:26:59.921891 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 145) took 2166 ms. Trace:
I20260812 19:26:59.922259 9037 rpcz_store.cc:276] 0812 19:26:57.755885 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.756192 (+ 307us) service_pool.cc:227] Handling call
0812 19:26:59.912367 (+2156175us) ts_tablet_manager.cc:1145] Deleting tablet a49e46c8ba704680bf12423854883b55
0812 19:26:59.917582 (+ 5215us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.919314 (+ 1732us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2154925}
I20260812 19:26:59.930433 8933 ts_tablet_manager.cc:1905] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:26:59.927532 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet a49e46c8ba704680bf12423854883b55 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a49e46c8ba704680bf12423854883b55 already in progress: creating tablet
I20260812 19:26:59.938171 9037 tablet_replica.cc:330] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:26:59.941989 8627 tablet_bootstrap.cc:654] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.979838 9037 raft_consensus.cc:2229] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:26:59.979972 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 384506029b4e49639f87f6d7005fa0a9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:58 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:26:59.984062 9037 raft_consensus.cc:2258] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:26:59.990568 8636 tablet_bootstrap.cc:654] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:26:59.997967 9037 ts_tablet_manager.cc:1905] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:00.003499 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 167) took 1290 ms. Trace:
I20260812 19:27:00.003855 8625 rpcz_store.cc:276] 0812 19:26:58.713107 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.714173 (+ 1066us) service_pool.cc:227] Handling call
0812 19:27:00.003064 (+1288891us) ts_tablet_manager.cc:1145] Deleting tablet cb55b45c8db944b18d1fcc0ea92dbebd
0812 19:27:00.003149 (+ 85us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.003420 (+ 271us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288300}
I20260812 19:27:00.004930 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 168) took 1289 ms. Trace:
I20260812 19:27:00.005178 8625 rpcz_store.cc:276] 0812 19:26:58.715325 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.715433 (+ 108us) service_pool.cc:227] Handling call
0812 19:27:00.004626 (+1289193us) ts_tablet_manager.cc:1145] Deleting tablet 69fe5774f8dc46308954e9be54bd92b2
0812 19:27:00.004682 (+ 56us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.004885 (+ 203us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288606}
I20260812 19:27:00.006209 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 169) took 1289 ms. Trace:
I20260812 19:27:00.006490 8625 rpcz_store.cc:276] 0812 19:26:58.716779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.716886 (+ 107us) service_pool.cc:227] Handling call
0812 19:27:00.005838 (+1288952us) ts_tablet_manager.cc:1145] Deleting tablet da5f9e7431654d5fbae5d554c6f14569
0812 19:27:00.005882 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.006167 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288432}
I20260812 19:27:00.007568 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 171) took 1102 ms. Trace:
I20260812 19:27:00.007802 8625 rpcz_store.cc:276] 0812 19:26:58.905683 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.905821 (+ 138us) service_pool.cc:227] Handling call
0812 19:27:00.007170 (+1101349us) ts_tablet_manager.cc:1145] Deleting tablet 863e7ca808f54a989b3372aa4bfe361e
0812 19:27:00.007242 (+ 72us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.007527 (+ 285us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1100606}
W20260812 19:27:00.014814 7959 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet e67867b6cb864b47ba7b115e12cddb17 consensus state has no leader
I20260812 19:27:00.017758 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 756557a37a924bcf9d7c0743beed6a9d (table default.Table_9f6c648486734773bac487f03209f60b [id=c04a06245afc4bc39447bcb6ca5940af]) successfully deleted
I20260812 19:27:00.019102 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:00.019896 7952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:00.023593 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 172) took 1116 ms. Trace:
I20260812 19:27:00.023512 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_aa20aa884fc649f2b4d34f146c2abf20"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:00.023959 8625 rpcz_store.cc:276] 0812 19:26:58.907707 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.907896 (+ 189us) service_pool.cc:227] Handling call
0812 19:27:00.012411 (+1104515us) ts_tablet_manager.cc:1145] Deleting tablet 22fe32c0d82845b8a9f0c0e4d88f7d39
0812 19:27:00.017735 (+ 5324us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.023531 (+ 5796us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1103818}
I20260812 19:27:00.028999 7958 catalog_manager.cc:6565] ReplaceTablet: tablet 5bce01fd81f04f23a8cddc3a7b5eae8f deleted and replaced by tablet 94407c13a91c4a76bd3aa1c1c8032384
I20260812 19:27:00.029500 9140 raft_consensus.cc:482] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:00.029939 9140 raft_consensus.cc:504] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:00.028930 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet cb55b45c8db944b18d1fcc0ea92dbebd because the tablet was not found. No further retry: Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd
W20260812 19:27:00.031253 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 69fe5774f8dc46308954e9be54bd92b2 because the tablet was not found. No further retry: Not found: Tablet not found: 69fe5774f8dc46308954e9be54bd92b2
W20260812 19:27:00.032043 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet da5f9e7431654d5fbae5d554c6f14569 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet da5f9e7431654d5fbae5d554c6f14569 already in progress: creating tablet
I20260812 19:27:00.032568 9049 raft_consensus.cc:482] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:00.032696 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 863e7ca808f54a989b3372aa4bfe361e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 863e7ca808f54a989b3372aa4bfe361e already in progress: creating tablet
W20260812 19:27:00.033433 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 already in progress: creating tablet
I20260812 19:27:00.033208 9049 raft_consensus.cc:504] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.033900 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 with delete_type TABLET_DATA_DELETED (replaced by tablet a91c4d5adb3d4f97939e38e9cee79532) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:00.034852 7952 catalog_manager.cc:6565] ReplaceTablet: tablet 249da5c0bd73498bbfc8f41e7513a9d4 deleted and replaced by tablet a91c4d5adb3d4f97939e38e9cee79532
I20260812 19:27:00.036487 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f with delete_type TABLET_DATA_DELETED (replaced by tablet 94407c13a91c4a76bd3aa1c1c8032384) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:00.036531 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 with delete_type TABLET_DATA_DELETED (replaced by tablet a91c4d5adb3d4f97939e38e9cee79532) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:00.036866 9140 leader_election.cc:288] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.036118 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f with delete_type TABLET_DATA_DELETED (replaced by tablet 94407c13a91c4a76bd3aa1c1c8032384) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:00.037421 9140 consensus_queue.cc:1035] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:00.036540 9049 leader_election.cc:288] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:00.037955 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_aa20aa884fc649f2b4d34f146c2abf20 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.044131 8625 tablet_replica.cc:330] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:00.052961 8627 tablet_bootstrap.cc:492] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:00.057462 7952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2b1b92a314d54a538f647f1d6b672b95" } new_table_name: "default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb" modify_external_catalogs: true
I20260812 19:27:00.059710 8627 ts_tablet_manager.cc:1397] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.164s user 0.017s sys 0.002s
I20260812 19:27:00.060386 8933 ts_tablet_manager.cc:1918] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:00.060777 8933 log.cc:1196] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/68583d63475a495ca97f3221825622e2
I20260812 19:27:00.061496 8933 ts_tablet_manager.cc:1939] T 68583d63475a495ca97f3221825622e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:00.061952 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_e78d88fddc174944a89591956ae7acec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:00.062561 8625 raft_consensus.cc:2229] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:27:00.063436 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e78d88fddc174944a89591956ae7acec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.066606 8483 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f with delete_type TABLET_DATA_DELETED (replaced by tablet 94407c13a91c4a76bd3aa1c1c8032384) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:00.067193 8485 tablet_service.cc:1514] Processing DeleteTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 with delete_type TABLET_DATA_DELETED (replaced by tablet a91c4d5adb3d4f97939e38e9cee79532) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:00.069687 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4dc5602ff1c24b6ab561389031d89885" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:00.072393 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29436abddcab4a46adb5aa0c54f45389" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:00.074412 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 141) took 1193 ms. Trace:
W20260812 19:27:00.071465 8107 leader_election.cc:341] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:00.079707 8107 leader_election.cc:341] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.080317 8625 raft_consensus.cc:2258] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:00.089977 8623 tablet_bootstrap.cc:492] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:00.090376 8623 ts_tablet_manager.cc:1397] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.394s user 0.068s sys 0.063s
I20260812 19:27:00.106666 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:00.109692 7962 catalog_manager.cc:5495] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
W20260812 19:27:00.085750 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 55766.6us
I20260812 19:27:00.121168 8625 ts_tablet_manager.cc:1905] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:00.127086 8623 raft_consensus.cc:348] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.128397 8623 raft_consensus.cc:374] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.130573 8623 raft_consensus.cc:729] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.131361 8623 consensus_queue.cc:260] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.145735 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29436abddcab4a46adb5aa0c54f45389" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:00.146412 8356 raft_consensus.cc:2454] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:27:00.157634 8108 leader_election.cc:341] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 4dc5602ff1c24b6ab561389031d89885
I20260812 19:27:00.158216 8108 leader_election.cc:302] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:00.159840 9187 raft_consensus.cc:2726] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:00.161270 8627 raft_consensus.cc:348] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.135958 8623 ts_tablet_manager.cc:1428] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.045s user 0.004s sys 0.003s
I20260812 19:27:00.178622 8623 tablet_bootstrap.cc:492] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:00.162037 8627 raft_consensus.cc:374] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.181443 8627 raft_consensus.cc:729] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.182365 8627 consensus_queue.cc:260] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.180640 8108 leader_election.cc:302] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:00.197275 9182 raft_consensus.cc:2781] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:00.197640 9182 raft_consensus.cc:482] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:00.197927 9182 raft_consensus.cc:3037] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:00.206280 8627 ts_tablet_manager.cc:1428] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.146s user 0.005s sys 0.003s
I20260812 19:27:00.208035 9182 raft_consensus.cc:504] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.091781 8636 tablet_bootstrap.cc:492] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:00.212591 8636 ts_tablet_manager.cc:1397] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.331s user 0.009s sys 0.004s
I20260812 19:27:00.212390 8933 rpcz_store.cc:276] 0812 19:26:58.880570 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.880796 (+ 226us) service_pool.cc:227] Handling call
0812 19:26:59.720141 (+839345us) ts_tablet_manager.cc:1145] Deleting tablet 68583d63475a495ca97f3221825622e2
0812 19:26:59.720183 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:26:59.954579 (+234396us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:00.001241 (+ 46662us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:00.074358 (+ 73117us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":774241}
I20260812 19:27:00.213174 8627 tablet_bootstrap.cc:492] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:00.214289 8933 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 139) took 1351 ms. Trace:
I20260812 19:27:00.121737 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2c80f7680532421eba6c258b2820ae59" } modify_external_catalogs: true
I20260812 19:27:00.214910 8636 raft_consensus.cc:348] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:00.215581 8636 raft_consensus.cc:374] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.215517 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2c80f7680532421eba6c258b2820ae59" } modify_external_catalogs: true
I20260812 19:27:00.215826 8636 raft_consensus.cc:729] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.211493 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29436abddcab4a46adb5aa0c54f45389" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:00.217247 8636 consensus_queue.cc:260] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:00.124635 7960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cb47cf36fb124675bbc53c97d2faecd9" } modify_external_catalogs: true
I20260812 19:27:00.219326 8636 ts_tablet_manager.cc:1428] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20260812 19:27:00.219172 7960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cb47cf36fb124675bbc53c97d2faecd9" } modify_external_catalogs: true
W20260812 19:27:00.190588 7945 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b (table default.Table_903471d080324d5480b38b2b6c7aa97a [id=fbf35ce6f2d04e8f9f732a8081a08372], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 4f7febfc2dcc4ec7a164485dbd6cac8b consensus state has no leader
I20260812 19:27:00.223542 9037 ts_tablet_manager.cc:1918] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:00.223973 9037 log.cc:1196] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/da5f9e7431654d5fbae5d554c6f14569
I20260812 19:27:00.223977 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]) successfully deleted
I20260812 19:27:00.225338 8636 tablet_bootstrap.cc:492] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:00.227514 8627 tablet_bootstrap.cc:654] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.228796 9187 raft_consensus.cc:482] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:00.229375 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3421abe40de04cbbada9c7c0e77840a8" } new_table_name: "default.Table_66db0774e1a04c57831ea5f32f5db73e" modify_external_catalogs: true
I20260812 19:27:00.229243 9187 raft_consensus.cc:504] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.230441 8636 tablet_bootstrap.cc:654] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.234161 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:00.235132 8352 raft_consensus.cc:2454] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:00.236726 8108 leader_election.cc:302] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:00.237663 9187 leader_election.cc:288] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.239425 9049 raft_consensus.cc:2781] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:00.244727 9049 raft_consensus.cc:482] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:00.245088 9049 raft_consensus.cc:3037] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:00.246012 9037 ts_tablet_manager.cc:1939] T da5f9e7431654d5fbae5d554c6f14569 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:00.253595 9049 raft_consensus.cc:504] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.257961 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:00.261096 7962 catalog_manager.cc:5495] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:00.262802 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
W20260812 19:27:00.272750 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9be4dabb7fa042bd8fa6b45fa63e8674 has no consensus state
I20260812 19:27:00.274050 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_9a72fd6596d64f3eb0d8ddb257918dad"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:00.274897 7960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet a84bf28a3e174f3b88f8758b09ced1f1
W20260812 19:27:00.275671 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_9a72fd6596d64f3eb0d8ddb257918dad in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.272603 7962 catalog_manager.cc:5495] T d49351be8d2a40109d88b54db11c4489 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:00.214653 8933 rpcz_store.cc:276] 0812 19:26:58.863312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.868670 (+ 5358us) service_pool.cc:227] Handling call
0812 19:27:00.213944 (+1345274us) ts_tablet_manager.cc:1145] Deleting tablet 863e7ca808f54a989b3372aa4bfe361e
0812 19:27:00.213988 (+ 44us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.214238 (+ 250us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1267784}
I20260812 19:27:00.279819 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 2b04529031f04302846b39d585d74ad5
I20260812 19:27:00.285400 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b04529031f04302846b39d585d74ad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:00.285917 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:00.295766 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 147) took 1753 ms. Trace:
I20260812 19:27:00.296363 9037 rpcz_store.cc:276] 0812 19:26:58.542573 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.564656 (+ 22083us) service_pool.cc:227] Handling call
0812 19:26:59.937996 (+1373340us) ts_tablet_manager.cc:1145] Deleting tablet da5f9e7431654d5fbae5d554c6f14569
0812 19:26:59.938041 (+ 45us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.184820 (+246779us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:00.223309 (+ 38489us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:00.295690 (+ 72381us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1372608}
I20260812 19:27:00.298395 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet da5f9e7431654d5fbae5d554c6f14569 (table default.Table_ad6af655b663482b88244d72f58c34c0 [id=a703135c7fcc446fba1a069bbf4c3b96]) successfully deleted
W20260812 19:27:00.301062 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 863e7ca808f54a989b3372aa4bfe361e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 863e7ca808f54a989b3372aa4bfe361e already in progress: creating tablet
I20260812 19:27:00.301653 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:27:00.303290 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet bdc25879cf7c434b91591a7c7382cdb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdc25879cf7c434b91591a7c7382cdb0 already in progress: creating tablet
W20260812 19:27:00.303931 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 384506029b4e49639f87f6d7005fa0a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 384506029b4e49639f87f6d7005fa0a9 already in progress: creating tablet
W20260812 19:27:00.304514 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bce01fd81f04f23a8cddc3a7b5eae8f already in progress: creating tablet
W20260812 19:27:00.259424 8107 leader_election.cc:341] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:00.304991 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 45602us
I20260812 19:27:00.305379 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b04529031f04302846b39d585d74ad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:27:00.305723 8107 consensus_peers.cc:487] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:00.306257 8107 leader_election.cc:341] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.278439 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:00.282393 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b04529031f04302846b39d585d74ad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:00.310377 9182 leader_election.cc:288] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.313735 8627 tablet_bootstrap.cc:492] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:00.314281 8627 ts_tablet_manager.cc:1397] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.107s user 0.004s sys 0.006s
I20260812 19:27:00.317931 9049 leader_election.cc:288] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.319300 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29436abddcab4a46adb5aa0c54f45389" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:00.319583 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:00.319938 8352 raft_consensus.cc:3037] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:00.320051 8356 raft_consensus.cc:3037] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:00.327538 8352 raft_consensus.cc:2454] T 29436abddcab4a46adb5aa0c54f45389 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:00.328613 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 148) took 1714 ms. Trace:
I20260812 19:27:00.328685 8108 leader_election.cc:302] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:00.329110 9037 rpcz_store.cc:276] 0812 19:26:58.614044 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.614481 (+ 437us) service_pool.cc:227] Handling call
0812 19:27:00.304713 (+1690232us) ts_tablet_manager.cc:1145] Deleting tablet eec275b2131d4848ae120d8a841a1cae
0812 19:27:00.311044 (+ 6331us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.328547 (+ 17503us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1676150}
I20260812 19:27:00.329794 9187 raft_consensus.cc:2781] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:00.330295 9187 raft_consensus.cc:686] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
W20260812 19:27:00.330983 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet eec275b2131d4848ae120d8a841a1cae because the tablet was not found. No further retry: Not found: Tablet not found: eec275b2131d4848ae120d8a841a1cae
I20260812 19:27:00.331192 9187 consensus_queue.cc:237] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.339979 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_4d7c3164521944d6896c30686703b9bd"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:00.341428 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4d7c3164521944d6896c30686703b9bd in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.341503 8356 raft_consensus.cc:2454] T 818eae7a6645415e992c25565f7f3b5a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:00.339881 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_3171b7ca23df44969511a0a7255fadd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:00.344828 8108 leader_election.cc:302] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:00.345659 9186 raft_consensus.cc:2781] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 19:27:00.345767 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3171b7ca23df44969511a0a7255fadd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.346176 9186 raft_consensus.cc:686] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:00.344858 8623 tablet_bootstrap.cc:654] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.346925 9186 consensus_queue.cc:237] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.353291 8625 ts_tablet_manager.cc:1918] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:00.367458 8625 log.cc:1196] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/68583d63475a495ca97f3221825622e2
I20260812 19:27:00.370206 8625 ts_tablet_manager.cc:1939] T 68583d63475a495ca97f3221825622e2 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:00.371717 8625 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 173) took 1462 ms. Trace:
I20260812 19:27:00.375133 8625 rpcz_store.cc:276] 0812 19:26:58.946339 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.946473 (+ 134us) service_pool.cc:227] Handling call
0812 19:27:00.025014 (+1078541us) ts_tablet_manager.cc:1145] Deleting tablet 68583d63475a495ca97f3221825622e2
0812 19:27:00.043946 (+ 18932us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.143301 (+ 99355us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:00.353055 (+209754us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:00.371663 (+ 18608us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1077942}
I20260812 19:27:00.377151 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]) successfully deleted
I20260812 19:27:00.390836 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:00.393358 8627 raft_consensus.cc:348] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.394192 8627 raft_consensus.cc:374] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.394470 8627 raft_consensus.cc:729] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.397197 9171 raft_consensus.cc:482] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:00.397445 8107 leader_election.cc:341] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.397626 9171 raft_consensus.cc:504] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.397723 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_0522318c18b84a738b8fb434656e38eb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:00.398377 8623 tablet_bootstrap.cc:492] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
W20260812 19:27:00.399353 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_0522318c18b84a738b8fb434656e38eb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.399735 9171 leader_election.cc:288] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:00.400271 8623 ts_tablet_manager.cc:1397] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.222s user 0.007s sys 0.006s
I20260812 19:27:00.402598 8623 raft_consensus.cc:348] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.403227 8623 raft_consensus.cc:374] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.403456 8623 raft_consensus.cc:729] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.404973 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e98e0f5b053649f1a5ab315312b37442" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:00.403049 8627 consensus_queue.cc:260] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:00.406409 8278 leader_election.cc:341] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.425125 8623 consensus_queue.cc:260] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.426477 8627 ts_tablet_manager.cc:1428] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.112s user 0.004s sys 0.002s
I20260812 19:27:00.440718 7958 master_service.cc:946] ReplaceTablet: received request to replace tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:00.445273 8627 tablet_bootstrap.cc:492] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:00.450343 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e98e0f5b053649f1a5ab315312b37442" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:00.451285 8623 ts_tablet_manager.cc:1428] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.051s user 0.006s sys 0.001s
W20260812 19:27:00.451828 8281 leader_election.cc:341] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.452239 8281 leader_election.cc:302] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:00.453119 8623 tablet_bootstrap.cc:492] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:00.453240 9171 raft_consensus.cc:2726] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:00.458909 8636 tablet_bootstrap.cc:492] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:00.459666 8636 ts_tablet_manager.cc:1397] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.234s user 0.026s sys 0.010s
W20260812 19:27:00.462517 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 249da5c0bd73498bbfc8f41e7513a9d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 249da5c0bd73498bbfc8f41e7513a9d4 already in progress: creating tablet
W20260812 19:27:00.463331 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet a84bf28a3e174f3b88f8758b09ced1f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a84bf28a3e174f3b88f8758b09ced1f1 already in progress: creating tablet
I20260812 19:27:00.465461 9140 consensus_queue.cc:1035] T b7d4a12b9c14415e8449d39663296450 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:00.477461 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 2b04529031f04302846b39d585d74ad5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b04529031f04302846b39d585d74ad5 already in progress: creating tablet
I20260812 19:27:00.477510 8636 raft_consensus.cc:348] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:00.332788 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 149) took 1523 ms. Trace:
I20260812 19:27:00.479712 9037 rpcz_store.cc:276] 0812 19:26:58.809431 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.809629 (+ 198us) service_pool.cc:227] Handling call
0812 19:27:00.332402 (+1522773us) ts_tablet_manager.cc:1145] Deleting tablet 863e7ca808f54a989b3372aa4bfe361e
0812 19:27:00.332448 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.332734 (+ 286us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1521988}
I20260812 19:27:00.480567 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_aa20aa884fc649f2b4d34f146c2abf20" } new_table_name: "default.Table_2e98d7b67f484dab9c439b8a37451d4d" modify_external_catalogs: true
I20260812 19:27:00.481221 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 150) took 1660 ms. Trace:
W20260812 19:27:00.481212 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 863e7ca808f54a989b3372aa4bfe361e because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 863e7ca808f54a989b3372aa4bfe361e already in progress: creating tablet
I20260812 19:27:00.481345 8636 raft_consensus.cc:374] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.481606 8636 raft_consensus.cc:729] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.481521 9037 rpcz_store.cc:276] 0812 19:26:58.821040 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.821217 (+ 177us) service_pool.cc:227] Handling call
0812 19:27:00.480832 (+1659615us) ts_tablet_manager.cc:1145] Deleting tablet 22fe32c0d82845b8a9f0c0e4d88f7d39
0812 19:27:00.480878 (+ 46us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.481153 (+ 275us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1658948}
W20260812 19:27:00.482601 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 already in progress: creating tablet
I20260812 19:27:00.482859 8623 tablet_bootstrap.cc:654] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.482985 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_72b6557e0f2d486f998ff2b1f7740b53" } modify_external_catalogs: true
I20260812 19:27:00.483474 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_72b6557e0f2d486f998ff2b1f7740b53" } modify_external_catalogs: true
I20260812 19:27:00.486007 9037 tablet_replica.cc:330] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:00.486836 9037 raft_consensus.cc:2229] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:00.487323 9037 raft_consensus.cc:2258] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:00.488569 8636 consensus_queue.cc:260] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:00.493513 7960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e78d88fddc174944a89591956ae7acec" } modify_external_catalogs: true
I20260812 19:27:00.494045 7960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e78d88fddc174944a89591956ae7acec" } modify_external_catalogs: true
I20260812 19:27:00.499171 8627 tablet_bootstrap.cc:654] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.510454 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 544d3d74baa6477da11abbee139ee66f
I20260812 19:27:00.512490 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 544d3d74baa6477da11abbee139ee66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:00.512763 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet b73ea5acf663420cbe9236c014d71199 has no consensus state
I20260812 19:27:00.513456 7958 master_service.cc:946] ReplaceTablet: received request to replace tablet 7d660422701a423794416b01cea825b4 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:00.513604 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet 544d3d74baa6477da11abbee139ee66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:00.514595 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 544d3d74baa6477da11abbee139ee66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
W20260812 19:27:00.518097 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 544d3d74baa6477da11abbee139ee66f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 544d3d74baa6477da11abbee139ee66f already in progress: creating tablet
I20260812 19:27:00.522930 7960 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet f133b11fcf634bcdba0e646bd4905b0f
I20260812 19:27:00.522796 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_6b73040a3e5b4db2b6f3cf71f7171c01"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:00.532737 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet bdc25879cf7c434b91591a7c7382cdb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdc25879cf7c434b91591a7c7382cdb0 already in progress: creating tablet
W20260812 19:27:00.533480 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 384506029b4e49639f87f6d7005fa0a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 384506029b4e49639f87f6d7005fa0a9 already in progress: creating tablet
I20260812 19:27:00.533617 8636 ts_tablet_manager.cc:1428] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.073s user 0.002s sys 0.005s
W20260812 19:27:00.534168 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 249da5c0bd73498bbfc8f41e7513a9d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 249da5c0bd73498bbfc8f41e7513a9d4 already in progress: creating tablet
W20260812 19:27:00.534835 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bce01fd81f04f23a8cddc3a7b5eae8f already in progress: creating tablet
W20260812 19:27:00.539963 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_6b73040a3e5b4db2b6f3cf71f7171c01 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:27:00.545504 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 2b04529031f04302846b39d585d74ad5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b04529031f04302846b39d585d74ad5 already in progress: creating tablet
W20260812 19:27:00.546263 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet a84bf28a3e174f3b88f8758b09ced1f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a84bf28a3e174f3b88f8758b09ced1f1 already in progress: creating tablet
I20260812 19:27:00.547583 9037 ts_tablet_manager.cc:1905] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:00.549561 8636 tablet_bootstrap.cc:492] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:00.552459 9182 raft_consensus.cc:482] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:00.553054 9182 raft_consensus.cc:504] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.555913 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbafc01c482b493a981aed31ce112885" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:00.556846 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 7d660422701a423794416b01cea825b4
W20260812 19:27:00.557452 8107 leader_election.cc:341] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.559018 9182 leader_election.cc:288] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.559542 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d660422701a423794416b01cea825b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ff5b2d23d734217b0b10e50834b8883) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:00.559742 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d660422701a423794416b01cea825b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ff5b2d23d734217b0b10e50834b8883) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:00.560433 7958 catalog_manager.cc:6565] ReplaceTablet: tablet 7d660422701a423794416b01cea825b4 deleted and replaced by tablet 6ff5b2d23d734217b0b10e50834b8883
I20260812 19:27:00.561905 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbafc01c482b493a981aed31ce112885" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:00.562548 8356 raft_consensus.cc:2454] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:00.563906 8108 leader_election.cc:302] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:00.564280 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d660422701a423794416b01cea825b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ff5b2d23d734217b0b10e50834b8883) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:00.567205 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 7d660422701a423794416b01cea825b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d660422701a423794416b01cea825b4 already in progress: creating tablet
I20260812 19:27:00.569854 7957 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:00.568164 9049 raft_consensus.cc:2781] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:00.571568 9049 raft_consensus.cc:482] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:00.574316 9049 raft_consensus.cc:3037] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:00.578760 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 544d3d74baa6477da11abbee139ee66f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 544d3d74baa6477da11abbee139ee66f already in progress: creating tablet
I20260812 19:27:00.579635 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_ed88cc07fe0945fd90987488667b3df3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:00.581192 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ed88cc07fe0945fd90987488667b3df3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:27:00.582882 7948 catalog_manager.cc:4914] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): alter failed for tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]),no further retry: Not found: Tablet not found: 68583d63475a495ca97f3221825622e2
I20260812 19:27:00.587026 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_1068c7ccc7344a52934df17a65628581"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:00.588796 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 7d660422701a423794416b01cea825b4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7d660422701a423794416b01cea825b4 already in progress: creating tablet
I20260812 19:27:00.591250 7957 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:00.592485 8623 tablet_bootstrap.cc:492] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:00.592911 8623 ts_tablet_manager.cc:1397] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.140s user 0.005s sys 0.006s
W20260812 19:27:00.606880 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1068c7ccc7344a52934df17a65628581 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.609915 8869 raft_consensus.cc:482] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:00.610230 8636 tablet_bootstrap.cc:654] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.610410 8869 raft_consensus.cc:504] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:00.612490 8869 leader_election.cc:288] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:00.618851 8446 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:27:00.613281 8623 raft_consensus.cc:348] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.619899 8623 raft_consensus.cc:374] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.620168 8623 raft_consensus.cc:729] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
W20260812 19:27:00.620187 8443 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:27:00.620576 8443 leader_election.cc:302] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:00.622609 8869 raft_consensus.cc:2726] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:00.622742 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d08ab761c18f419d8314bc123c7c262a"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:00.624446 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d08ab761c18f419d8314bc123c7c262a in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:00.625262 8623 consensus_queue.cc:260] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.626695 9186 raft_consensus.cc:482] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:00.627112 9186 raft_consensus.cc:504] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.629118 9186 leader_election.cc:288] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.630398 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaaf04a85946447aa43873e3568aa3a3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:00.631059 8351 raft_consensus.cc:2454] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:00.632287 8108 leader_election.cc:302] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:00.632216 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaaf04a85946447aa43873e3568aa3a3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:00.633495 8623 ts_tablet_manager.cc:1428] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
W20260812 19:27:00.634092 8107 leader_election.cc:341] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.634369 8623 tablet_bootstrap.cc:492] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:00.633657 8627 tablet_bootstrap.cc:492] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:00.642078 8627 ts_tablet_manager.cc:1397] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.197s user 0.008s sys 0.002s
I20260812 19:27:00.644097 8636 tablet_bootstrap.cc:492] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:00.644771 8627 raft_consensus.cc:348] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.645663 8627 raft_consensus.cc:374] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.645943 8627 raft_consensus.cc:729] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.646448 8636 ts_tablet_manager.cc:1397] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.097s user 0.009s sys 0.001s
I20260812 19:27:00.646641 8627 consensus_queue.cc:260] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.654246 9182 raft_consensus.cc:2781] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:00.654611 9182 raft_consensus.cc:482] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:00.654939 9182 raft_consensus.cc:3037] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:00.654110 8636 raft_consensus.cc:348] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.660043 8627 ts_tablet_manager.cc:1428] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260812 19:27:00.660893 8636 raft_consensus.cc:374] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.661590 8636 raft_consensus.cc:729] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.662886 8636 consensus_queue.cc:260] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.669749 8636 ts_tablet_manager.cc:1428] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.023s user 0.004s sys 0.001s
I20260812 19:27:00.674515 9182 raft_consensus.cc:504] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.676971 8636 tablet_bootstrap.cc:492] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:00.683295 8636 tablet_bootstrap.cc:654] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.686777 9182 leader_election.cc:288] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.684553 9049 raft_consensus.cc:504] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.692206 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaaf04a85946447aa43873e3568aa3a3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:00.715754 8107 leader_election.cc:341] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.718320 9049 leader_election.cc:288] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:00.724638 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbafc01c482b493a981aed31ce112885" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:00.730069 8107 leader_election.cc:341] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.733250 8627 tablet_bootstrap.cc:492] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:00.746016 8636 tablet_bootstrap.cc:492] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:00.753041 8636 ts_tablet_manager.cc:1397] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.002s
I20260812 19:27:00.757028 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaaf04a85946447aa43873e3568aa3a3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:00.757946 8351 raft_consensus.cc:3037] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:00.760879 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dbafc01c482b493a981aed31ce112885" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:00.761899 8356 raft_consensus.cc:3037] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:00.766386 8636 raft_consensus.cc:348] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.767060 8636 raft_consensus.cc:374] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.767284 8636 raft_consensus.cc:729] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.773123 8636 consensus_queue.cc:260] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.781077 8623 tablet_bootstrap.cc:654] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.789714 8636 ts_tablet_manager.cc:1428] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.036s user 0.007s sys 0.001s
I20260812 19:27:00.791571 7960 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ba69209df0f0461caf32a56c6faa35ed" } new_table_name: "default.Table_63c9865ea2de4a1fa2ffee030ee0e003" modify_external_catalogs: true
I20260812 19:27:00.792817 8636 tablet_bootstrap.cc:492] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:00.795224 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_6b73040a3e5b4db2b6f3cf71f7171c01" } modify_external_catalogs: true
I20260812 19:27:00.795794 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_6b73040a3e5b4db2b6f3cf71f7171c01" } modify_external_catalogs: true
I20260812 19:27:00.821064 8627 tablet_bootstrap.cc:654] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.826344 9171 raft_consensus.cc:482] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:00.831368 8636 tablet_bootstrap.cc:654] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.831307 9171 raft_consensus.cc:504] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.838294 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22fe32c0d82845b8a9f0c0e4d88f7d39" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:00.845906 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22fe32c0d82845b8a9f0c0e4d88f7d39" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:00.848707 8278 leader_election.cc:341] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:00.852782 8281 leader_election.cc:341] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:00.853283 8281 leader_election.cc:302] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:00.857410 8636 tablet_bootstrap.cc:492] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
W20260812 19:27:00.857342 7960 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 067fdfc16a7e44c2b3dac5fe262a5728 has no consensus state
I20260812 19:27:00.857914 8636 ts_tablet_manager.cc:1397] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.067s user 0.011s sys 0.009s
I20260812 19:27:00.864326 7955 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet 89dcc05fee524901906846d37eb59de9
I20260812 19:27:00.865325 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cff1f67e93a94ddf996036b7f50622ad" } modify_external_catalogs: true
I20260812 19:27:00.865836 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cff1f67e93a94ddf996036b7f50622ad" } modify_external_catalogs: true
I20260812 19:27:00.870675 8636 raft_consensus.cc:348] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.871421 8636 raft_consensus.cc:374] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:00.871734 8636 raft_consensus.cc:729] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:00.872608 9171 leader_election.cc:288] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:00.872512 8636 consensus_queue.cc:260] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.883662 9171 raft_consensus.cc:2726] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:00.885350 8636 ts_tablet_manager.cc:1428] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.022s user 0.007s sys 0.001s
I20260812 19:27:00.893767 8636 tablet_bootstrap.cc:492] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:00.894244 8356 raft_consensus.cc:2454] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:00.896297 8108 leader_election.cc:302] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:00.911855 8636 tablet_bootstrap.cc:654] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:00.887930 8351 raft_consensus.cc:2454] T eaaf04a85946447aa43873e3568aa3a3 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:00.917274 8108 leader_election.cc:302] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:00.897456 9049 raft_consensus.cc:2781] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:00.921460 9049 raft_consensus.cc:686] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:00.919966 9137 raft_consensus.cc:2781] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:00.924690 9137 raft_consensus.cc:686] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:00.925933 9137 consensus_queue.cc:237] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:00.922851 9049 consensus_queue.cc:237] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:00.960206 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 63559.4us
W20260812 19:27:00.964908 7945 consensus_peers.cc:487] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 -> Peer 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563): Couldn't send request to peer 1e9a660a0f1e4fc6bc6335b38eece0bd. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260812 19:27:00.990345 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 92d412842c9c4dd0bb47e774d1df8e4b (DEFAULT_TABLE table=default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:00.991482 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d412842c9c4dd0bb47e774d1df8e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:00.997133 8487 tablet_service.cc:1467] Processing CreateTablet for tablet 92d412842c9c4dd0bb47e774d1df8e4b (DEFAULT_TABLE table=default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:00.999012 8636 tablet_bootstrap.cc:492] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:00.999364 8487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d412842c9c4dd0bb47e774d1df8e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.011107 8636 ts_tablet_manager.cc:1397] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.117s user 0.013s sys 0.023s
I20260812 19:27:01.012439 8485 tablet_service.cc:1467] Processing CreateTablet for tablet f41e6528b71e4d35a6aee94bb7dd7a57 (DEFAULT_TABLE table=default.Table_0c169ee9078f4bed9f0e3611083f1540 [id=fb2cc5bfeacf477fb0455ef2c27cd2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.014487 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f41e6528b71e4d35a6aee94bb7dd7a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.022292 8623 tablet_bootstrap.cc:492] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:01.022416 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 58149ab874b44f63b01ea611814e1417
I20260812 19:27:01.022710 8623 ts_tablet_manager.cc:1397] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.389s user 0.010s sys 0.012s
I20260812 19:27:01.025322 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 58149ab874b44f63b01ea611814e1417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:01.027079 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 58149ab874b44f63b01ea611814e1417 because the tablet was not found. No further retry: Not found: Tablet not found: 58149ab874b44f63b01ea611814e1417
I20260812 19:27:01.029388 8483 tablet_service.cc:1514] Processing DeleteTablet for tablet 58149ab874b44f63b01ea611814e1417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:27:01.032141 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 58149ab874b44f63b01ea611814e1417 because the tablet was not found. No further retry: Not found: Tablet not found: 58149ab874b44f63b01ea611814e1417
I20260812 19:27:01.034096 8636 raft_consensus.cc:348] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.035006 8636 raft_consensus.cc:374] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:01.035405 8636 raft_consensus.cc:729] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:01.004057 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_2b1b92a314d54a538f647f1d6b672b95 [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 1 got 0
I20260812 19:27:01.045166 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:01.044744 8636 consensus_queue.cc:260] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.046599 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:01.047664 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 1950030ab501429a91971f80f761a172 (table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]). Expected version 1 got 0
I20260812 19:27:01.056974 8156 tablet_service.cc:1467] Processing CreateTablet for tablet f41e6528b71e4d35a6aee94bb7dd7a57 (DEFAULT_TABLE table=default.Table_0c169ee9078f4bed9f0e3611083f1540 [id=fb2cc5bfeacf477fb0455ef2c27cd2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.058894 8483 tablet_service.cc:1467] Processing CreateTablet for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6 (DEFAULT_TABLE table=default.Table_711ff99c0d184bbd8214b29510d407cc [id=9b70345d8fa242b886b0fcf6433af593]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.061124 8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.063700 8636 ts_tablet_manager.cc:1428] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.052s user 0.003s sys 0.006s
I20260812 19:27:01.064335 8869 raft_consensus.cc:482] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:01.065606 8869 raft_consensus.cc:504] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:01.071942 9184 raft_consensus.cc:482] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:01.071885 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:01.070561 8869 leader_election.cc:288] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:01.072762 9184 raft_consensus.cc:504] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.079119 9184 leader_election.cc:288] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:01.079967 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd34ec17d8c4609ad979fab951c8a96" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:01.080952 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f41e6528b71e4d35a6aee94bb7dd7a57. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:01.082165 8107 leader_election.cc:341] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:01.086072 8636 tablet_bootstrap.cc:492] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:01.092571 8482 tablet_service.cc:1467] Processing CreateTablet for tablet 9293d85d08c34dbeb3f324322f2d656c (DEFAULT_TABLE table=default.Table_848e8c259ba3498d9a99ca7a371c2e2d [id=7aef5ac0f0b24593a0c78e7d3864eb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.093997 8482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9293d85d08c34dbeb3f324322f2d656c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.093451 8152 tablet_service.cc:1467] Processing CreateTablet for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6 (DEFAULT_TABLE table=default.Table_711ff99c0d184bbd8214b29510d407cc [id=9b70345d8fa242b886b0fcf6433af593]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.095516 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.100051 8636 tablet_bootstrap.cc:654] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:01.110904 8623 raft_consensus.cc:348] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.111939 8623 raft_consensus.cc:374] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:01.120806 7958 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:01.122001 7958 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:01.123471 7958 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:01.133587 8623 raft_consensus.cc:729] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:01.135277 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 92d412842c9c4dd0bb47e774d1df8e4b (DEFAULT_TABLE table=default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:27:01.135641 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 282875us
I20260812 19:27:01.136305 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92d412842c9c4dd0bb47e774d1df8e4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.134479 8623 consensus_queue.cc:260] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.137583 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd34ec17d8c4609ad979fab951c8a96" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:01.138594 8354 raft_consensus.cc:2454] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:01.139601 8623 ts_tablet_manager.cc:1428] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.116s user 0.007s sys 0.001s
I20260812 19:27:01.139752 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 58149ab874b44f63b01ea611814e1417 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.140852 8327 tablet_service.cc:1467] Processing CreateTablet for tablet f41e6528b71e4d35a6aee94bb7dd7a57 (DEFAULT_TABLE table=default.Table_0c169ee9078f4bed9f0e3611083f1540 [id=fb2cc5bfeacf477fb0455ef2c27cd2be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.141837 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f41e6528b71e4d35a6aee94bb7dd7a57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.145138 8326 tablet_service.cc:1467] Processing CreateTablet for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6 (DEFAULT_TABLE table=default.Table_711ff99c0d184bbd8214b29510d407cc [id=9b70345d8fa242b886b0fcf6433af593]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.145689 8108 leader_election.cc:302] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:01.146240 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.149415 9137 raft_consensus.cc:2781] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:01.149955 9137 raft_consensus.cc:482] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:01.150480 9137 raft_consensus.cc:3037] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:01.155560 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11eb974d35ba42418292e5a9fa82e331" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:01.157976 8443 leader_election.cc:302] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:01.160022 8869 raft_consensus.cc:2726] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:01.164115 8623 tablet_bootstrap.cc:492] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:01.170970 8511 raft_consensus.cc:3037] T 11eb974d35ba42418292e5a9fa82e331 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:01.182606 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 9293d85d08c34dbeb3f324322f2d656c (DEFAULT_TABLE table=default.Table_848e8c259ba3498d9a99ca7a371c2e2d [id=7aef5ac0f0b24593a0c78e7d3864eb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.183951 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9293d85d08c34dbeb3f324322f2d656c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.189159 8155 tablet_service.cc:1467] Processing CreateTablet for tablet cfbf700d55a04b529507259406bdd5a1 (DEFAULT_TABLE table=default.Table_62f170365c8247b1ab9704bfc9ec48dc [id=ec789caf7cfb479f802dd26563c0bb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.190367 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfbf700d55a04b529507259406bdd5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.193439 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 9293d85d08c34dbeb3f324322f2d656c (DEFAULT_TABLE table=default.Table_848e8c259ba3498d9a99ca7a371c2e2d [id=7aef5ac0f0b24593a0c78e7d3864eb09]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.193845 8322 tablet_service.cc:1467] Processing CreateTablet for tablet cfbf700d55a04b529507259406bdd5a1 (DEFAULT_TABLE table=default.Table_62f170365c8247b1ab9704bfc9ec48dc [id=ec789caf7cfb479f802dd26563c0bb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.194519 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9293d85d08c34dbeb3f324322f2d656c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.195102 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfbf700d55a04b529507259406bdd5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.197805 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:01.205920 8493 tablet_service.cc:1467] Processing CreateTablet for tablet cfbf700d55a04b529507259406bdd5a1 (DEFAULT_TABLE table=default.Table_62f170365c8247b1ab9704bfc9ec48dc [id=ec789caf7cfb479f802dd26563c0bb76]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.207126 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfbf700d55a04b529507259406bdd5a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.227912 8636 tablet_bootstrap.cc:492] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:01.228359 8636 ts_tablet_manager.cc:1397] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.142s user 0.033s sys 0.015s
I20260812 19:27:01.230564 8636 raft_consensus.cc:348] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.231371 8636 raft_consensus.cc:374] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:01.231638 8636 raft_consensus.cc:729] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:01.221786 7960 catalog_manager.cc:5495] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:01.244753 8627 tablet_bootstrap.cc:492] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:01.245240 8627 ts_tablet_manager.cc:1397] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.551s user 0.014s sys 0.010s
I20260812 19:27:01.232221 8636 consensus_queue.cc:260] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.244710 8494 tablet_service.cc:1467] Processing CreateTablet for tablet 05b8e6cecfa04aa685014277c15fb6f4 (DEFAULT_TABLE table=default.Table_fac2d883e0444e638b031f6bd0209b93 [id=e878f91b7f3749eb9acd213ea6e31430]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.245114 7960 catalog_manager.cc:5495] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
W20260812 19:27:01.256857 7948 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet e67867b6cb864b47ba7b115e12cddb17 (table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e67867b6cb864b47ba7b115e12cddb17 consensus state has no leader
I20260812 19:27:01.260015 8636 ts_tablet_manager.cc:1428] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260812 19:27:01.268306 8623 tablet_bootstrap.cc:654] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:01.268882 8636 tablet_bootstrap.cc:492] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:01.264586 7960 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:01.278718 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 05b8e6cecfa04aa685014277c15fb6f4 (DEFAULT_TABLE table=default.Table_fac2d883e0444e638b031f6bd0209b93 [id=e878f91b7f3749eb9acd213ea6e31430]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.280110 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05b8e6cecfa04aa685014277c15fb6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.282550 8514 raft_consensus.cc:3037] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:01.271986 9137 raft_consensus.cc:504] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.306774 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 067fdfc16a7e44c2b3dac5fe262a5728 (DEFAULT_TABLE table=default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.307753 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067fdfc16a7e44c2b3dac5fe262a5728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.311329 9171 raft_consensus.cc:482] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:01.316437 8323 tablet_service.cc:1467] Processing CreateTablet for tablet 05b8e6cecfa04aa685014277c15fb6f4 (DEFAULT_TABLE table=default.Table_fac2d883e0444e638b031f6bd0209b93 [id=e878f91b7f3749eb9acd213ea6e31430]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.319383 8328 tablet_service.cc:1467] Processing CreateTablet for tablet 067fdfc16a7e44c2b3dac5fe262a5728 (DEFAULT_TABLE table=default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.311949 9171 raft_consensus.cc:504] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.329999 8627 raft_consensus.cc:348] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.333063 9137 leader_election.cc:288] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:01.363109 7955 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:01.365788 7953 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569] alter complete (version 1)
I20260812 19:27:01.370059 7952 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 192) took 1611 ms. Trace:
I20260812 19:27:01.374276 8623 tablet_bootstrap.cc:492] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:01.375010 8623 ts_tablet_manager.cc:1397] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.211s user 0.007s sys 0.013s
I20260812 19:27:01.379321 8623 raft_consensus.cc:348] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.380219 8623 raft_consensus.cc:374] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:01.385228 8623 raft_consensus.cc:729] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:01.370401 7952 rpcz_store.cc:276] 0812 19:26:59.758189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.037266 (+279077us) service_pool.cc:227] Handling call
0812 19:27:00.057350 (+ 20084us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf7d6 00007f05ee9f5634 00007f05ee9f55c2 00007f05ee9f54f1 00007f05ee9f546c 00007f05ee9f4722 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:00.058085 (+ 735us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:00.059596 (+ 1511us) catalog_manager.cc:3616] Apply alter schema
0812 19:27:00.060136 (+ 540us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:27:00.060343 (+ 207us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:27:00.167326 (+106983us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:27:01.370000 (+1202674us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:00.095250 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:00.095673 (+ 423us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:00.095703 (+ 30us) write_op.cc:435] Acquired schema lock
0812 19:27:00.095719 (+ 16us) tablet.cc:660] Decoding operations
0812 19:27:00.096034 (+ 315us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:00.096078 (+ 44us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:00.096105 (+ 27us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:00.096284 (+ 179us) tablet.cc:699] Row locks acquired
0812 19:27:00.096303 (+ 19us) write_op.cc:260] PREPARE: finished
0812 19:27:00.096440 (+ 137us) write_op.cc:270] Start()
0812 19:27:00.096537 (+ 97us) write_op.cc:276] Timestamp: P: 1786562820096359 usec, L: 0
0812 19:27:00.096552 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:27:00.097050 (+ 498us) log.cc:842] Serialized 405 byte log entry
0812 19:27:00.164854 (+ 67804us) op_driver.cc:444] REPLICATION: finished
0812 19:27:00.165431 (+ 577us) write_op.cc:301] APPLY: starting
0812 19:27:00.165491 (+ 60us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:00.165592 (+ 101us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:00.165720 (+ 128us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:00.165887 (+ 167us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:00.166045 (+ 158us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:00.166102 (+ 57us) write_op.cc:312] APPLY: finished
0812 19:27:00.166309 (+ 207us) log.cc:842] Serialized 23 byte log entry
0812 19:27:00.166989 (+ 680us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.167057 (+ 68us) write_op.cc:454] Released schema lock
0812 19:27:00.167090 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:00.167748 (+ 658us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.167777 (+ 29us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":43091200,"child_traces":[["op",{"apply.queue_time_us":399,"apply.run_cpu_time_us":1556,"apply.run_wall_time_us":2509,"num_ops":1,"prepare.queue_time_us":33822,"prepare.run_cpu_time_us":2042,"prepare.run_wall_time_us":17669,"replication_time_us":68224}]]}
I20260812 19:27:01.386008 8623 consensus_queue.cc:260] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.387017 7952 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_5286b447ea52443c84d86022710997bc"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:01.388705 7952 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_5286b447ea52443c84d86022710997bc in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:01.394618 8623 ts_tablet_manager.cc:1428] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.019s user 0.004s sys 0.004s
I20260812 19:27:01.404305 8627 raft_consensus.cc:374] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:01.404784 8627 raft_consensus.cc:729] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:01.339423 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067fdfc16a7e44c2b3dac5fe262a5728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.410701 7953 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c] alter complete (version 2)
I20260812 19:27:01.413251 8623 tablet_bootstrap.cc:492] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:01.413555 7953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 33) took 2630 ms (client timeout 1000 ms). Trace:
I20260812 19:27:01.420562 7962 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277] alter complete (version 1)
W20260812 19:27:01.434793 7959 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 34) took 1536 ms (client timeout 1000 ms). Trace:
W20260812 19:27:01.435496 7959 rpcz_store.cc:269] 0812 19:26:59.898278 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.016795 (+118517us) service_pool.cc:227] Handling call
0812 19:27:01.434669 (+1417874us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":8}
I20260812 19:27:01.443958 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f73e97db5954612ab9dfa21bc435efd with delete_type TABLET_DATA_DELETED (replaced by tablet a84bf28a3e174f3b88f8758b09ced1f1) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.446244 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.446727 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 756557a37a924bcf9d7c0743beed6a9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.447499 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.450680 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 68583d63475a495ca97f3221825622e2 with delete_type TABLET_DATA_DELETED (replaced by tablet bc8ae6adf7b64a468112753c2831ac87) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.451603 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 017b6bfef5f44da0866917e04e2db072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.453181 9171 leader_election.cc:288] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:01.454255 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d660422701a423794416b01cea825b4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:01.455611 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05b8e6cecfa04aa685014277c15fb6f4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:01.456554 8281 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:01.461172 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.462718 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.463127 9137 consensus_queue.cc:1035] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:27:01.463830 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 5f73e97db5954612ab9dfa21bc435efd because the tablet was not found. No further retry: Not found: Tablet not found: 5f73e97db5954612ab9dfa21bc435efd
W20260812 19:27:01.464561 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet cb55b45c8db944b18d1fcc0ea92dbebd because the tablet was not found. No further retry: Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd
W20260812 19:27:01.465180 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 756557a37a924bcf9d7c0743beed6a9d because the tablet was not found. No further retry: Not found: Tablet not found: 756557a37a924bcf9d7c0743beed6a9d
W20260812 19:27:01.465700 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 69fe5774f8dc46308954e9be54bd92b2 because the tablet was not found. No further retry: Not found: Tablet not found: 69fe5774f8dc46308954e9be54bd92b2
W20260812 19:27:01.466240 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 68583d63475a495ca97f3221825622e2 because the tablet was not found. No further retry: Not found: Tablet not found: 68583d63475a495ca97f3221825622e2
W20260812 19:27:01.466749 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 017b6bfef5f44da0866917e04e2db072 because the tablet was not found. No further retry: Not found: Tablet not found: 017b6bfef5f44da0866917e04e2db072
I20260812 19:27:01.466715 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.467069 8623 tablet_bootstrap.cc:654] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:01.466759 8627 consensus_queue.cc:260] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.469449 8627 ts_tablet_manager.cc:1428] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.224s user 0.006s sys 0.001s
I20260812 19:27:01.470757 8625 tablet_replica.cc:330] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:01.471760 8625 raft_consensus.cc:2229] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:01.473973 8625 pending_rounds.cc:62] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:27:01.474268 8625 pending_rounds.cc:68] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761305708806144 op_type: NO_OP noop_request { }
I20260812 19:27:01.474737 8625 raft_consensus.cc:2866] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:01.475473 8625 raft_consensus.cc:2258] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:01.477753 9137 raft_consensus.cc:482] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:01.478351 9137 raft_consensus.cc:504] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.482223 9137 leader_election.cc:288] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:01.490901 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 because the tablet was not found. No further retry: Not found: Tablet not found: 6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:27:01.497251 8625 ts_tablet_manager.cc:1905] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:01.347277 9037 ts_tablet_manager.cc:1918] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:01.503327 9037 log.cc:1196] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/68583d63475a495ca97f3221825622e2
I20260812 19:27:01.504710 9037 ts_tablet_manager.cc:1939] T 68583d63475a495ca97f3221825622e2 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:01.512235 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd34ec17d8c4609ad979fab951c8a96" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:01.513362 8351 raft_consensus.cc:3037] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:01.534035 7954 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 27) took 3273 ms (client timeout 1000 ms). Trace:
I20260812 19:27:01.536001 8623 tablet_bootstrap.cc:492] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:01.536721 8623 ts_tablet_manager.cc:1397] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.124s user 0.011s sys 0.006s
I20260812 19:27:01.540186 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.542588 8623 raft_consensus.cc:348] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.549306 8623 raft_consensus.cc:374] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:01.553645 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet da5f9e7431654d5fbae5d554c6f14569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.563738 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.564203 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.568034 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.551275 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:01.561265 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 58149ab874b44f63b01ea611814e1417 (DEFAULT_TABLE table=default.Table_cff1f67e93a94ddf996036b7f50622ad [id=a6a842af942a409298ef85050e94ea7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.570739 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58149ab874b44f63b01ea611814e1417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.573274 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 58149ab874b44f63b01ea611814e1417 (DEFAULT_TABLE table=default.Table_cff1f67e93a94ddf996036b7f50622ad [id=a6a842af942a409298ef85050e94ea7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.574139 8627 tablet_bootstrap.cc:492] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:01.576649 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58149ab874b44f63b01ea611814e1417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.580423 8152 tablet_service.cc:1467] Processing CreateTablet for tablet bc8ae6adf7b64a468112753c2831ac87 (DEFAULT_TABLE table=default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.582787 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc8ae6adf7b64a468112753c2831ac87. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:01.542706 7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 28) took 1953 ms (client timeout 1000 ms). Trace:
W20260812 19:27:01.555814 7957 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 33) took 1890 ms (client timeout 1000 ms). Trace:
I20260812 19:27:01.553043 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_84a4d8dea4e74a5dbd72b6e2c747742b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:01.589357 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_84a4d8dea4e74a5dbd72b6e2c747742b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:01.591449 8332 tablet_service.cc:1467] Processing CreateTablet for tablet 9be4dabb7fa042bd8fa6b45fa63e8674 (DEFAULT_TABLE table=default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.592479 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9be4dabb7fa042bd8fa6b45fa63e8674. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:01.413924 7953 rpcz_store.cc:269] 0812 19:26:58.782879 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.807502 (+ 24623us) service_pool.cc:227] Handling call
0812 19:26:58.918637 (+111135us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:01.413457 (+2494820us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:58.932946 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:58.933373 (+ 427us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:58.933396 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:26:58.933408 (+ 12us) tablet.cc:660] Decoding operations
0812 19:26:58.933782 (+ 374us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:58.933825 (+ 43us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:58.933857 (+ 32us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:26:58.934009 (+ 152us) tablet.cc:699] Row locks acquired
0812 19:26:58.934022 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:26:58.934134 (+ 112us) write_op.cc:270] Start()
0812 19:26:58.934233 (+ 99us) write_op.cc:276] Timestamp: P: 1786562818934069 usec, L: 0
0812 19:26:58.934250 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:26:58.934843 (+ 593us) log.cc:842] Serialized 356 byte log entry
0812 19:26:58.995934 (+ 61091us) op_driver.cc:444] REPLICATION: finished
0812 19:26:58.999752 (+ 3818us) write_op.cc:301] APPLY: starting
0812 19:26:58.999839 (+ 87us) tablet.cc:1365] starting BulkCheckPresence
0812 19:26:59.000008 (+ 169us) tablet.cc:1368] finished BulkCheckPresence
0812 19:26:59.000238 (+ 230us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:26:59.004360 (+ 4122us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:26:59.004659 (+ 299us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:26:59.004825 (+ 166us) write_op.cc:312] APPLY: finished
0812 19:26:59.005190 (+ 365us) log.cc:842] Serialized 23 byte log entry
0812 19:26:59.006273 (+ 1083us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:59.006413 (+ 140us) write_op.cc:454] Released schema lock
0812 19:26:59.006498 (+ 85us) write_op.cc:341] FINISH: Updating metrics
0812 19:26:59.006816 (+ 318us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:26:59.006841 (+ 25us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 19:27:01.368317 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:01.368678 (+ 361us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:01.368700 (+ 22us) write_op.cc:435] Acquired schema lock
0812 19:27:01.368714 (+ 14us) tablet.cc:660] Decoding operations
0812 19:27:01.368997 (+ 283us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:01.369034 (+ 37us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:01.369057 (+ 23us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:01.369208 (+ 151us) tablet.cc:699] Row locks acquired
0812 19:27:01.369221 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:27:01.369328 (+ 107us) write_op.cc:270] Start()
0812 19:27:01.369407 (+ 79us) write_op.cc:276] Timestamp: P: 1786562821369279 usec, L: 0
0812 19:27:01.369421 (+ 14us) op_driver.cc:331] REPLICATION: starting
0812 19:27:01.375844 (+ 6423us) log.cc:842] Serialized 356 byte log entry
0812 19:27:01.376727 (+ 883us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64471 00007f05eeedb198 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9 00007f05ef340ab1 00007f05ef33fdad 0000000000580784 00000000005805b9
0812 19:27:01.401495 (+ 24768us) op_driver.cc:444] REPLICATION: finished
0812 19:27:01.401878 (+ 383us) write_op.cc:301] APPLY: starting
0812 19:27:01.401991 (+ 113us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:01.402155 (+ 164us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:01.402212 (+ 57us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:01.402441 (+ 229us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:01.402775 (+ 334us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:01.402872 (+ 97us) write_op.cc:312] APPLY: finished
0812 19:27:01.403297 (+ 425us) log.cc:842] Serialized 23 byte log entry
0812 19:27:01.403533 (+ 236us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:01.403652 (+ 119us) write_op.cc:454] Released schema lock
0812 19:27:01.403696 (+ 44us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:01.403988 (+ 292us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:01.404039 (+ 51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":6,"spinlock_wait_cycles":237548800,"child_traces":[["op",{"apply.queue_time_us":3619,"apply.run_cpu_time_us":3053,"apply.run_wall_time_us":7351,"num_ops":1,"prepare.queue_time_us":1702,"prepare.run_cpu_time_us":2201,"prepare.run_wall_time_us":5909,"raft.queue_time_us":3454,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":54,"replication_time_us":61557}],["op",{"apply.queue_time_us":128,"apply.run_cpu_time_us":2419,"apply.run_wall_time_us":2419,"num_ops":1,"prepare.queue_time_us":94,"prepare.run_cpu_time_us":5668,"prepare.run_wall_time_us":11433,"raft.queue_time_us":7900,"raft.run_cpu_time_us":1347,"raft.run_wall_time_us":18364,"replication_time_us":31933,"spinlock_wait_cycles":13477632,"thread_start_us":2665,"threads_started":1}]]}
W20260812 19:27:01.587687 7957 rpcz_store.cc:269] 0812 19:26:59.665792 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:59.754614 (+ 88822us) service_pool.cc:227] Handling call
0812 19:26:59.815453 (+ 60839us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:01.555735 (+1740282us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2661,"reported_tablets":19,"spinlock_wait_cycles":102076288}
I20260812 19:27:01.596127 7953 master_service.cc:946] ReplaceTablet: received request to replace tablet 14f1198fb9b646b5ae473cfbdfcd7a8d from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:01.598435 8156 tablet_service.cc:1467] Processing CreateTablet for tablet 9be4dabb7fa042bd8fa6b45fa63e8674 (DEFAULT_TABLE table=default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.599798 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9be4dabb7fa042bd8fa6b45fa63e8674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.599669 8326 tablet_service.cc:1467] Processing CreateTablet for tablet bc8ae6adf7b64a468112753c2831ac87 (DEFAULT_TABLE table=default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:27:01.601529 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 32) took 2988 ms (client timeout 1000 ms). Trace:
I20260812 19:27:01.601742 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc8ae6adf7b64a468112753c2831ac87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.601742 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 354d9912acad4c1ba76f45ce277f1e94 (DEFAULT_TABLE table=default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.602727 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 354d9912acad4c1ba76f45ce277f1e94. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:01.605199 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 72951.8us
W20260812 19:27:01.612675 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 29) took 814 ms (client timeout 1000 ms). Trace:
I20260812 19:27:01.619376 8328 tablet_service.cc:1467] Processing CreateTablet for tablet 354d9912acad4c1ba76f45ce277f1e94 (DEFAULT_TABLE table=default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.620340 8623 raft_consensus.cc:729] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:01.621069 8623 consensus_queue.cc:260] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.597712 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_78b8216abc99490ba45598cd4f0a6588"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:01.623797 8623 ts_tablet_manager.cc:1428] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.087s user 0.004s sys 0.003s
W20260812 19:27:01.625005 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_78b8216abc99490ba45598cd4f0a6588 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:27:01.584813 7954 rpcz_store.cc:269] 0812 19:26:58.260672 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.260830 (+ 158us) service_pool.cc:227] Handling call
0812 19:26:58.281900 (+ 21070us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:01.533946 (+3252046us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:26:59.924326 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:26:59.925310 (+ 984us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:26:59.925380 (+ 70us) write_op.cc:435] Acquired schema lock
0812 19:26:59.925436 (+ 56us) tablet.cc:660] Decoding operations
0812 19:26:59.926283 (+ 847us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:26:59.926408 (+ 125us) write_op.cc:641] Partition lock acquired for write op
0812 19:26:59.926479 (+ 71us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:00.019710 (+ 93231us) tablet.cc:699] Row locks acquired
0812 19:27:00.019731 (+ 21us) write_op.cc:260] PREPARE: finished
0812 19:27:00.019861 (+ 130us) write_op.cc:270] Start()
0812 19:27:00.019952 (+ 91us) write_op.cc:276] Timestamp: P: 1786562820019789 usec, L: 0
0812 19:27:00.019970 (+ 18us) op_driver.cc:331] REPLICATION: starting
0812 19:27:00.020534 (+ 564us) log.cc:842] Serialized 913 byte log entry
0812 19:27:00.090872 (+ 70338us) op_driver.cc:444] REPLICATION: finished
0812 19:27:00.091635 (+ 763us) write_op.cc:301] APPLY: starting
0812 19:27:00.091694 (+ 59us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:00.091802 (+ 108us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:00.091939 (+ 137us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:00.092306 (+ 367us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:00.092467 (+ 161us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:00.092517 (+ 50us) write_op.cc:312] APPLY: finished
0812 19:27:00.092730 (+ 213us) log.cc:842] Serialized 29 byte log entry
0812 19:27:00.092899 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.092970 (+ 71us) write_op.cc:454] Released schema lock
0812 19:27:00.093012 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:00.093195 (+ 183us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.093223 (+ 28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":516,"reported_tablets":19,"spinlock_wait_cycles":37960448,"child_traces":[["op",{"apply.queue_time_us":596,"apply.run_cpu_time_us":1797,"apply.run_wall_time_us":1796,"num_ops":2,"prepare.queue_time_us":151724,"prepare.run_cpu_time_us":3102,"prepare.run_wall_time_us":100224,"raft.queue_time_us":102,"raft.run_cpu_time_us":759,"raft.run_wall_time_us":759,"replication_time_us":70796}]]}
I20260812 19:27:01.628883 7954 master_service.cc:946] ReplaceTablet: received request to replace tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:01.637737 8490 tablet_service.cc:1514] Processing DeleteTablet for tablet cb55b45c8db944b18d1fcc0ea92dbebd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:49 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:01.639967 8493 tablet_service.cc:1514] Processing DeleteTablet for tablet 69fe5774f8dc46308954e9be54bd92b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:01.640198 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet 68583d63475a495ca97f3221825622e2 with delete_type TABLET_DATA_DELETED (replaced by tablet bc8ae6adf7b64a468112753c2831ac87) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:01.641114 8636 tablet_bootstrap.cc:654] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:01.647459 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 354d9912acad4c1ba76f45ce277f1e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.633625 9171 raft_consensus.cc:482] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:01.650148 9171 raft_consensus.cc:504] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.628538 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.655956 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96839764810f4b7e9b3dd7a64be85dd1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:01.656950 8179 raft_consensus.cc:2454] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:01.645498 8869 raft_consensus.cc:482] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:01.658530 8281 leader_election.cc:302] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:01.659373 9209 raft_consensus.cc:2781] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:01.659813 9209 raft_consensus.cc:482] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:01.660418 9209 raft_consensus.cc:3037] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:01.661917 8278 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.Ping -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 46902.6us
W20260812 19:27:01.601832 7956 rpcz_store.cc:269] 0812 19:26:58.613472 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:58.620603 (+ 7131us) service_pool.cc:227] Handling call
0812 19:26:58.636100 (+ 15497us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:01.601466 (+2965366us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19165,"reported_tablets":18,"spinlock_wait_cycles":28073216}
I20260812 19:27:01.665200 7956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_e3b24459b2554cd3883378cdf0a9fb61"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:01.667814 7956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_e3b24459b2554cd3883378cdf0a9fb61 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:01.655925 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 05b8e6cecfa04aa685014277c15fb6f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.651733 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet 017b6bfef5f44da0866917e04e2db072 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:01.675321 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 067fdfc16a7e44c2b3dac5fe262a5728 (DEFAULT_TABLE table=default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.677960 8625 ts_tablet_manager.cc:1918] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:01.669044 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet 756557a37a924bcf9d7c0743beed6a9d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:50 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:01.655797 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d660422701a423794416b01cea825b4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:01.688083 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 067fdfc16a7e44c2b3dac5fe262a5728. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.697983 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 58149ab874b44f63b01ea611814e1417 (DEFAULT_TABLE table=default.Table_cff1f67e93a94ddf996036b7f50622ad [id=a6a842af942a409298ef85050e94ea7e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.699400 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58149ab874b44f63b01ea611814e1417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.685071 8623 tablet_bootstrap.cc:492] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:01.699738 8625 log.cc:1196] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/453a403d1c0b4b5c8dcd9b93c7cc9ea4
I20260812 19:27:01.669659 8869 raft_consensus.cc:504] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.702980 8869 leader_election.cc:288] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:01.703429 8869 raft_consensus.cc:482] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:01.708719 8625 ts_tablet_manager.cc:1939] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:01.688546 9171 leader_election.cc:288] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:01.687891 9209 raft_consensus.cc:504] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.733690 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96839764810f4b7e9b3dd7a64be85dd1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:01.734746 8179 raft_consensus.cc:3037] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:01.740195 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 (table default.Table_e13f5860d61746f4b3d9ecda0df98a09 [id=dbcf165b445f4ef8a27f2d58ac93b3d2]) successfully deleted
W20260812 19:27:01.741223 8108 leader_election.cc:341] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: da5f9e7431654d5fbae5d554c6f14569
I20260812 19:27:01.742903 9182 consensus_queue.cc:1035] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:01.748399 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 151) took 2761 ms. Trace:
I20260812 19:27:01.749727 8625 tablet_replica.cc:330] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:01.749450 9037 rpcz_store.cc:276] 0812 19:26:59.003264 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:59.003397 (+ 133us) service_pool.cc:227] Handling call
0812 19:27:00.485846 (+1482449us) ts_tablet_manager.cc:1145] Deleting tablet 68583d63475a495ca97f3221825622e2
0812 19:27:00.485887 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:00.889209 (+403322us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:01.346814 (+457605us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:01.748233 (+401419us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2816,"tablet-delete.queue_time_us":1481906}
I20260812 19:27:01.756659 8625 raft_consensus.cc:2229] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:27:01.765316 7955 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 35) took 855 ms (client timeout 1000 ms). Trace:
W20260812 19:27:01.765653 7955 rpcz_store.cc:269] 0812 19:27:00.909590 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.024590 (+115000us) service_pool.cc:227] Handling call
0812 19:27:01.765256 (+740666us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":12}
I20260812 19:27:01.750902 8623 tablet_bootstrap.cc:654] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:01.768239 8625 pending_rounds.cc:62] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:27:01.769256 8625 pending_rounds.cc:68] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761300826669056 op_type: NO_OP noop_request { }
I20260812 19:27:01.770635 8625 raft_consensus.cc:2866] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:01.771512 8625 raft_consensus.cc:2258] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:01.772451 7952 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_118fda3ccbbb4a1f9e380936b8ad2002" } modify_external_catalogs: true
I20260812 19:27:01.772933 7953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_4f6e1ed970454d05afe6de4cbae88fd6" } new_table_name: "default.Table_767024638c874185886b998ebb58a292" modify_external_catalogs: true
I20260812 19:27:01.773440 7952 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_118fda3ccbbb4a1f9e380936b8ad2002" } modify_external_catalogs: true
W20260812 19:27:01.585958 7962 rpcz_store.cc:269] 0812 19:26:59.589267 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:59.589381 (+ 114us) service_pool.cc:227] Handling call
0812 19:26:59.670170 (+ 80789us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:01.542620 (+1872450us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:00.507373 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:00.507724 (+ 351us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:00.507749 (+ 25us) write_op.cc:435] Acquired schema lock
0812 19:27:00.507761 (+ 12us) tablet.cc:660] Decoding operations
0812 19:27:00.508125 (+ 364us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:00.508160 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:00.508180 (+ 20us) tablet.cc:683] Acquiring locks for 3 operations
0812 19:27:00.508451 (+ 271us) tablet.cc:699] Row locks acquired
0812 19:27:00.508464 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:27:00.508562 (+ 98us) write_op.cc:270] Start()
0812 19:27:00.508637 (+ 75us) write_op.cc:276] Timestamp: P: 1786562820508495 usec, L: 0
0812 19:27:00.508663 (+ 26us) op_driver.cc:331] REPLICATION: starting
0812 19:27:00.509103 (+ 440us) log.cc:842] Serialized 1293 byte log entry
0812 19:27:00.529397 (+ 20294us) op_driver.cc:444] REPLICATION: finished
0812 19:27:00.529952 (+ 555us) write_op.cc:301] APPLY: starting
0812 19:27:00.530005 (+ 53us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:00.530123 (+ 118us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:00.530216 (+ 93us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:00.530536 (+ 320us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:00.530689 (+ 153us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0812 19:27:00.530738 (+ 49us) write_op.cc:312] APPLY: finished
0812 19:27:00.530933 (+ 195us) log.cc:842] Serialized 35 byte log entry
0812 19:27:00.531071 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.531143 (+ 72us) write_op.cc:454] Released schema lock
0812 19:27:00.531176 (+ 33us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:00.531341 (+ 165us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.531364 (+ 23us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 19:27:00.727007 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:00.727338 (+ 331us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:00.727363 (+ 25us) write_op.cc:435] Acquired schema lock
0812 19:27:00.727375 (+ 12us) tablet.cc:660] Decoding operations
0812 19:27:00.727602 (+ 227us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:00.727634 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:00.727655 (+ 21us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:00.727799 (+ 144us) tablet.cc:699] Row locks acquired
0812 19:27:00.727812 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:27:00.727904 (+ 92us) write_op.cc:270] Start()
0812 19:27:00.727981 (+ 77us) write_op.cc:276] Timestamp: P: 1786562820727868 usec, L: 0
0812 19:27:00.727997 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:27:00.728433 (+ 436us) log.cc:842] Serialized 356 byte log entry
0812 19:27:00.752726 (+ 24293us) op_driver.cc:444] REPLICATION: finished
0812 19:27:00.787393 (+ 34667us) write_op.cc:301] APPLY: starting
0812 19:27:00.787478 (+ 85us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:00.787632 (+ 154us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:00.787819 (+ 187us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:00.788380 (+ 561us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:00.789086 (+ 706us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:00.789179 (+ 93us) write_op.cc:312] APPLY: finished
0812 19:27:00.789528 (+ 349us) log.cc:842] Serialized 23 byte log entry
0812 19:27:00.789792 (+ 264us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.789917 (+ 125us) write_op.cc:454] Released schema lock
0812 19:27:00.789962 (+ 45us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:00.790230 (+ 268us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:00.790268 (+ 38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18561,"reported_tablets":17,"spinlock_wait_cycles":177703296,"child_traces":[["op",{"apply.queue_time_us":403,"apply.run_cpu_time_us":1600,"apply.run_wall_time_us":1599,"num_ops":3,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":1895,"prepare.run_wall_time_us":1895,"replication_time_us":20659}],["op",{"apply.queue_time_us":285,"apply.run_cpu_time_us":2763,"apply.run_wall_time_us":3157,"mutex_wait_us":74521,"num_ops":1,"prepare.queue_time_us":77070,"prepare.run_cpu_time_us":1589,"prepare.run_wall_time_us":1587,"replication_time_us":24574}]]}
I20260812 19:27:01.779878 7962 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_8d0e87a9ef4c4bdab9558d30c7597948" } new_table_name: "default.Table_d9ab701326cf41578d26ff86740c3c06" modify_external_catalogs: true
I20260812 19:27:01.780462 9209 leader_election.cc:288] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:01.783056 7959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_0522318c18b84a738b8fb434656e38eb" } modify_external_catalogs: true
I20260812 19:27:01.786883 8179 raft_consensus.cc:2454] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:01.787827 7959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_0522318c18b84a738b8fb434656e38eb" } modify_external_catalogs: true
I20260812 19:27:01.789088 8281 leader_election.cc:302] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:01.791563 8625 ts_tablet_manager.cc:1905] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:01.613023 7960 rpcz_store.cc:269] 0812 19:27:00.798399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.858177 (+ 59778us) service_pool.cc:227] Handling call
0812 19:27:01.612609 (+754432us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:01.301657 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:01.302169 (+ 512us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:01.302205 (+ 36us) write_op.cc:435] Acquired schema lock
0812 19:27:01.302219 (+ 14us) tablet.cc:660] Decoding operations
0812 19:27:01.302609 (+ 390us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:01.302651 (+ 42us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:01.302674 (+ 23us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:01.302973 (+ 299us) tablet.cc:699] Row locks acquired
0812 19:27:01.302988 (+ 15us) write_op.cc:260] PREPARE: finished
0812 19:27:01.303123 (+ 135us) write_op.cc:270] Start()
0812 19:27:01.303212 (+ 89us) write_op.cc:276] Timestamp: P: 1786562821303066 usec, L: 0
0812 19:27:01.303227 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:27:01.310962 (+ 7735us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b5400022018. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05efc070c4 00007f05eeeb34f9 00007f05eee6ef91 00007f05eee6ec6a 00007f05eeedacd5 00007f05eeedb179 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9
0812 19:27:01.311291 (+ 329us) log.cc:842] Serialized 913 byte log entry
0812 19:27:01.342914 (+ 31623us) op_driver.cc:444] REPLICATION: finished
0812 19:27:01.351829 (+ 8915us) write_op.cc:301] APPLY: starting
0812 19:27:01.351945 (+ 116us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:01.352162 (+ 217us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:01.352215 (+ 53us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:01.352700 (+ 485us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:01.352979 (+ 279us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:01.353085 (+ 106us) write_op.cc:312] APPLY: finished
0812 19:27:01.353430 (+ 345us) log.cc:842] Serialized 29 byte log entry
0812 19:27:01.353698 (+ 268us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:01.353819 (+ 121us) write_op.cc:454] Released schema lock
0812 19:27:01.353876 (+ 57us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:01.354195 (+ 319us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:01.354246 (+ 51us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":8580,"apply.run_cpu_time_us":2704,"apply.run_wall_time_us":2704,"num_ops":2,"prepare.queue_time_us":12007,"prepare.run_cpu_time_us":4594,"prepare.run_wall_time_us":10024,"raft.queue_time_us":5032,"raft.run_cpu_time_us":1036,"raft.run_wall_time_us":1035,"replication_time_us":39578,"spinlock_wait_cycles":13069056}]]}
I20260812 19:27:01.801363 9209 raft_consensus.cc:2781] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:01.803277 9209 raft_consensus.cc:686] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:01.804503 9209 consensus_queue.cc:237] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.805282 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.807412 8322 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:01.809736 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 68583d63475a495ca97f3221825622e2 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]) successfully deleted
I20260812 19:27:01.813889 8623 tablet_bootstrap.cc:492] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:01.814294 8623 ts_tablet_manager.cc:1397] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.129s user 0.012s sys 0.007s
I20260812 19:27:01.861028 8483 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:01.862581 8488 tablet_service.cc:1467] Processing CreateTablet for tablet bc8ae6adf7b64a468112753c2831ac87 (DEFAULT_TABLE table=default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.866060 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 354d9912acad4c1ba76f45ce277f1e94 (DEFAULT_TABLE table=default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.867429 8483 tablet_service.cc:1467] Processing CreateTablet for tablet 9be4dabb7fa042bd8fa6b45fa63e8674 (DEFAULT_TABLE table=default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:01.869405 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:01.871385 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bc8ae6adf7b64a468112753c2831ac87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.872587 8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9be4dabb7fa042bd8fa6b45fa63e8674. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.876525 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 354d9912acad4c1ba76f45ce277f1e94. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:01.703904 8869 raft_consensus.cc:504] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.883303 8869 leader_election.cc:288] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:01.883572 8625 ts_tablet_manager.cc:1918] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:01.884048 8625 log.cc:1196] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/eec275b2131d4848ae120d8a841a1cae
I20260812 19:27:01.885013 8625 ts_tablet_manager.cc:1939] T eec275b2131d4848ae120d8a841a1cae P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:01.885300 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96839764810f4b7e9b3dd7a64be85dd1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:01.915918 8636 tablet_bootstrap.cc:492] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:01.916399 8636 ts_tablet_manager.cc:1397] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.648s user 0.010s sys 0.008s
I20260812 19:27:01.936831 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96839764810f4b7e9b3dd7a64be85dd1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:01.949684 8278 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:01.950181 8278 leader_election.cc:302] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:01.952310 9171 raft_consensus.cc:2726] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:01.962343 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:01.967505 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 159) took 2204 ms. Trace:
I20260812 19:27:01.974655 9235 raft_consensus.cc:482] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:01.975822 7958 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 34) took 1229 ms (client timeout 1000 ms). Trace:
I20260812 19:27:01.975457 9235 raft_consensus.cc:504] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.977679 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_3edb2611b0cb4de78624e0ffdf32222c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:01.979437 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_3edb2611b0cb4de78624e0ffdf32222c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:01.986476 7952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 7e087bad986b423098a68fa5d05ff17a
I20260812 19:27:01.995546 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e087bad986b423098a68fa5d05ff17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:01 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:02.013818 8623 raft_consensus.cc:348] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.014781 8623 raft_consensus.cc:374] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:02.015043 8623 raft_consensus.cc:729] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:02.015610 8623 consensus_queue.cc:260] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:01.886415 8625 tablet_replica.cc:330] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:02.018234 8625 raft_consensus.cc:2229] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260812 19:27:02.018919 7953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 7764a1ae009142b29d5fb574dca45e21 consensus state has no leader
I20260812 19:27:02.023226 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet eec275b2131d4848ae120d8a841a1cae (table default.Table_77f5368431cf473daab21a349c850ca8 [id=e680e4a33c234a20be57640b6f7c4e61]) successfully deleted
I20260812 19:27:02.027402 9137 consensus_queue.cc:1035] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:02.024480 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "818eae7a6645415e992c25565f7f3b5a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:02.032524 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e087bad986b423098a68fa5d05ff17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:01 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:01.976192 7958 rpcz_store.cc:269] 0812 19:27:00.746638 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.746821 (+ 183us) service_pool.cc:227] Handling call
0812 19:27:01.975742 (+1228921us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3608,"reported_tablets":21}
I20260812 19:27:02.036410 8625 raft_consensus.cc:2258] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:02.037439 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 88842.5us
I20260812 19:27:02.046474 8627 tablet_bootstrap.cc:654] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:02.050103 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_02dbea084f02412db88eb169e6bb5cf7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:02.052909 9182 raft_consensus.cc:482] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:02.053843 9182 raft_consensus.cc:504] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.060750 8625 ts_tablet_manager.cc:1905] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:02.071354 8351 consensus_meta.cc:287] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Time spent flushing consensus metadata: real 0.557s user 0.008s sys 0.004s
I20260812 19:27:02.071978 8351 raft_consensus.cc:2454] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:02.048215 9037 rpcz_store.cc:276] 0812 19:26:59.763534 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:59.763912 (+ 378us) service_pool.cc:227] Handling call
0812 19:27:01.951870 (+2187958us) ts_tablet_manager.cc:1145] Deleting tablet bdc25879cf7c434b91591a7c7382cdb0
0812 19:27:01.966839 (+ 14969us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800001898. stack: 00007f865924a033 00007f8659249f30 00007f8658dcb534 00000000004db2b4 00000000004db249 00007f86590c0f11 00007f8659244851 00007f8659244e82 00007f86620f88b9 00007f866112c5d8 00007f86611f0389 00007f86611f0983 00007f8661220e10 00007f8661207e0d 00007f8661207db9 00007f8661207d49
0812 19:27:01.966917 (+ 78us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:01.967407 (+ 490us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28233088,"tablet-delete.queue_time_us":2187104}
W20260812 19:27:02.092684 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_02dbea084f02412db88eb169e6bb5cf7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:02.090725 9182 leader_election.cc:288] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:02.221930 8623 ts_tablet_manager.cc:1428] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.407s user 0.010s sys 0.006s
I20260812 19:27:02.234900 8623 tablet_bootstrap.cc:492] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:02.265727 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ed3743a7dde744668cbe91759a499805 consensus state has no leader
W20260812 19:27:01.964563 8485 consensus_meta.cc:287] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.679s user 0.008s sys 0.006s
I20260812 19:27:02.204883 8515 raft_consensus.cc:3037] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:02.139287 8869 raft_consensus.cc:482] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:02.291824 8485 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 159) took 1281 ms. Trace:
I20260812 19:27:02.174553 8636 raft_consensus.cc:348] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.293418 8636 raft_consensus.cc:374] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:02.293825 8636 raft_consensus.cc:729] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:02.294771 8636 consensus_queue.cc:260] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.145370 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1bd34ec17d8c4609ad979fab951c8a96" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:02.206511 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da5f9e7431654d5fbae5d554c6f14569" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:02.182282 8482 consensus_meta.cc:287] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.902s user 0.003s sys 0.007s
I20260812 19:27:02.298578 8482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 162) took 1207 ms. Trace:
I20260812 19:27:02.299021 8482 rpcz_store.cc:276] 0812 19:27:01.090777 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.090937 (+ 160us) service_pool.cc:227] Handling call
0812 19:27:01.093435 (+ 2498us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:01.093519 (+ 84us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:01.280094 (+186575us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:02.297956 (+1017862us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:02.298436 (+ 480us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:02.300200 8625 ts_tablet_manager.cc:1918] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:02.300654 8625 log.cc:1196] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/4dc5602ff1c24b6ab561389031d89885
I20260812 19:27:02.177942 8517 raft_consensus.cc:3037] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:02.301390 8625 ts_tablet_manager.cc:1939] T 4dc5602ff1c24b6ab561389031d89885 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:02.302524 8625 tablet_replica.cc:330] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:02.303444 8625 raft_consensus.cc:2229] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:02.304085 8625 pending_rounds.cc:62] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:27:02.316126 8625 pending_rounds.cc:68] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761314566959104 op_type: NO_OP noop_request { }
I20260812 19:27:02.316691 8625 raft_consensus.cc:2866] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:02.317106 8625 raft_consensus.cc:2258] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:02.319263 8625 ts_tablet_manager.cc:1905] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:02.352161 8625 ts_tablet_manager.cc:1918] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:02.352676 8625 log.cc:1196] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/dbafc01c482b493a981aed31ce112885
I20260812 19:27:02.353602 8625 ts_tablet_manager.cc:1939] T dbafc01c482b493a981aed31ce112885 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:02.240024 8512 raft_consensus.cc:3037] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:02.291695 8869 raft_consensus.cc:504] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.363478 8869 leader_election.cc:288] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:02.326910 8636 ts_tablet_manager.cc:1428] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.406s user 0.021s sys 0.013s
I20260812 19:27:02.365602 7956 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 217) took 1361 ms. Trace:
I20260812 19:27:02.092715 8495 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e087bad986b423098a68fa5d05ff17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:01 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:02.348059 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e98e0f5b053649f1a5ab315312b37442" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:02.255411 9233 tablet_replica.cc:330] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:02.369436 7957 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 215) took 1516 ms. Trace:
I20260812 19:27:02.369655 9233 raft_consensus.cc:2229] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:02.370828 9233 raft_consensus.cc:2258] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:02.369819 7957 rpcz_store.cc:276] 0812 19:27:00.852773 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.597171 (+744398us) service_pool.cc:227] Handling call
0812 19:27:01.816577 (+219406us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:27:01.990293 (+173716us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:27:02.145567 (+155274us) catalog_manager.cc:2181] Wrote table and tablets to system table
0812 19:27:02.369113 (+223546us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0812 19:27:02.369381 (+ 268us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:02.056312 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:02.057049 (+ 737us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:02.057105 (+ 56us) write_op.cc:435] Acquired schema lock
0812 19:27:02.057189 (+ 84us) tablet.cc:660] Decoding operations
0812 19:27:02.057677 (+ 488us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:02.057753 (+ 76us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:02.057776 (+ 23us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:02.058163 (+ 387us) tablet.cc:699] Row locks acquired
0812 19:27:02.058179 (+ 16us) write_op.cc:260] PREPARE: finished
0812 19:27:02.058379 (+ 200us) write_op.cc:270] Start()
0812 19:27:02.058536 (+ 157us) write_op.cc:276] Timestamp: P: 1786562822058283 usec, L: 0
0812 19:27:02.058563 (+ 27us) op_driver.cc:331] REPLICATION: starting
0812 19:27:02.059554 (+ 991us) log.cc:842] Serialized 433 byte log entry
0812 19:27:02.132040 (+ 72486us) op_driver.cc:444] REPLICATION: finished
0812 19:27:02.138096 (+ 6056us) write_op.cc:301] APPLY: starting
0812 19:27:02.138278 (+ 182us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:02.138620 (+ 342us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:02.138936 (+ 316us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:02.140365 (+ 1429us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:02.141017 (+ 652us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 19:27:02.141276 (+ 259us) write_op.cc:312] APPLY: finished
0812 19:27:02.142973 (+ 1697us) log.cc:842] Serialized 29 byte log entry
0812 19:27:02.144235 (+ 1262us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:02.145061 (+ 826us) write_op.cc:454] Released schema lock
0812 19:27:02.145207 (+ 146us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:02.146242 (+ 1035us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:02.146334 (+ 92us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":4699,"apply.run_cpu_time_us":4490,"apply.run_wall_time_us":8642,"num_ops":2,"prepare.queue_time_us":64580,"prepare.run_cpu_time_us":2759,"prepare.run_wall_time_us":4980,"replication_time_us":73253}]]}
I20260812 19:27:02.372689 9233 ts_tablet_manager.cc:1905] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:02.385077 9247 log.cc:924] Time spent T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
I20260812 19:27:02.386724 8514 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.7.144.193:44699 (request call id 147) took 1105 ms. Trace:
I20260812 19:27:02.387076 8514 rpcz_store.cc:276] 0812 19:27:01.281359 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.281590 (+ 231us) service_pool.cc:227] Handling call
0812 19:27:01.282323 (+ 733us) raft_consensus.cc:1457] Updating replica for 1 ops
0812 19:27:01.711179 (+428856us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:27:01.711220 (+ 41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0812 19:27:01.712125 (+ 905us) log.cc:842] Serialized 26 byte log entry
0812 19:27:02.125672 (+413547us) raft_consensus.cc:1631] Marking committed up to 0
0812 19:27:02.131317 (+ 5645us) raft_consensus.cc:1683] Filling consensus response to leader.
0812 19:27:02.145554 (+ 14237us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0812 19:27:02.386513 (+240959us) raft_consensus.cc:1671] finished
0812 19:27:02.386535 (+ 22us) raft_consensus.cc:1677] UpdateReplicas() finished
0812 19:27:02.386655 (+ 120us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":263038,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":265,"thread_start_us":184620,"threads_started":1,"wal-append.queue_time_us":580032}
W20260812 19:27:02.388339 8107 consensus_peers.cc:487] T 29436abddcab4a46adb5aa0c54f45389 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:02.393662 8107 leader_election.cc:341] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:02.394271 8107 leader_election.cc:341] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:02.394604 8107 leader_election.cc:302] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:02.397152 9257 raft_consensus.cc:2726] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:02.345059 9235 leader_election.cc:288] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:02.090159 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 160) took 2275 ms. Trace:
I20260812 19:27:02.403172 9037 rpcz_store.cc:276] 0812 19:26:59.814723 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:59.814883 (+ 160us) service_pool.cc:227] Handling call
0812 19:27:02.088209 (+2273326us) ts_tablet_manager.cc:1145] Deleting tablet 384506029b4e49639f87f6d7005fa0a9
0812 19:27:02.088401 (+ 192us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:02.089683 (+ 1282us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2269485}
I20260812 19:27:02.405679 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 163) took 2372 ms. Trace:
I20260812 19:27:02.292483 8485 rpcz_store.cc:276] 0812 19:27:01.010779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.010963 (+ 184us) service_pool.cc:227] Handling call
0812 19:27:01.013560 (+ 2597us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:01.013753 (+ 193us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:01.284534 (+270781us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:02.291173 (+1006639us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:02.291766 (+ 593us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:02.419850 8107 leader_election.cc:341] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:02.410132 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 370758us
I20260812 19:27:02.438841 8623 tablet_bootstrap.cc:654] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:02.373993 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet cb55b45c8db944b18d1fcc0ea92dbebd because the tablet was not found. No further retry: Not found: Tablet not found: cb55b45c8db944b18d1fcc0ea92dbebd
W20260812 19:27:02.449221 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 75240us
I20260812 19:27:02.366029 7956 rpcz_store.cc:276] 0812 19:27:01.004332 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.664467 (+660135us) service_pool.cc:227] Handling call
0812 19:27:01.943807 (+279340us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:27:01.945524 (+ 1717us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:27:02.346887 (+401363us) catalog_manager.cc:2181] Wrote table and tablets to system table
0812 19:27:02.365198 (+ 18311us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0812 19:27:02.365540 (+ 342us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:02.061389 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:02.061962 (+ 573us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:02.061989 (+ 27us) write_op.cc:435] Acquired schema lock
0812 19:27:02.062000 (+ 11us) tablet.cc:660] Decoding operations
0812 19:27:02.062685 (+ 685us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:02.062742 (+ 57us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:02.062761 (+ 19us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:02.063179 (+ 418us) tablet.cc:699] Row locks acquired
0812 19:27:02.063193 (+ 14us) write_op.cc:260] PREPARE: finished
0812 19:27:02.063368 (+ 175us) write_op.cc:270] Start()
0812 19:27:02.063468 (+ 100us) write_op.cc:276] Timestamp: P: 1786562822063290 usec, L: 0
0812 19:27:02.063532 (+ 64us) op_driver.cc:331] REPLICATION: starting
0812 19:27:02.065062 (+ 1530us) log.cc:842] Serialized 433 byte log entry
0812 19:27:02.141882 (+ 76820us) op_driver.cc:444] REPLICATION: finished
0812 19:27:02.147372 (+ 5490us) write_op.cc:301] APPLY: starting
0812 19:27:02.147586 (+ 214us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:02.221982 (+ 74396us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:02.222133 (+ 151us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:02.262726 (+ 40593us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:02.262933 (+ 207us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 19:27:02.262995 (+ 62us) write_op.cc:312] APPLY: finished
0812 19:27:02.263238 (+ 243us) log.cc:842] Serialized 29 byte log entry
0812 19:27:02.346526 (+ 83288us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:02.346605 (+ 79us) write_op.cc:454] Released schema lock
0812 19:27:02.346642 (+ 37us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:02.347331 (+ 689us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:02.347387 (+ 56us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":5106,"apply.run_cpu_time_us":2592,"apply.run_wall_time_us":200410,"mutex_wait_us":90187,"num_ops":2,"prepare.queue_time_us":114255,"prepare.run_cpu_time_us":2597,"prepare.run_wall_time_us":5090,"replication_time_us":78214}]]}
I20260812 19:27:02.386554 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 4dc5602ff1c24b6ab561389031d89885 (table default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]) successfully deleted
W20260812 19:27:02.452668 7948 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 66136.4us
I20260812 19:27:02.453189 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet dbafc01c482b493a981aed31ce112885 (table default.Table_becd7e0ffc7a45f28e5cdf225a55abbb [id=9c67f412032b44b583e41a660ed0329e]) successfully deleted
W20260812 19:27:02.453764 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 7e087bad986b423098a68fa5d05ff17a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e087bad986b423098a68fa5d05ff17a already in progress: creating tablet
I20260812 19:27:02.461740 8636 tablet_bootstrap.cc:492] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:02.463276 7956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_df6e7bbfeab2475e99f37f8653d5e8e1" } modify_external_catalogs: true
I20260812 19:27:02.464340 7956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_df6e7bbfeab2475e99f37f8653d5e8e1" } modify_external_catalogs: true
I20260812 19:27:02.467360 8636 tablet_bootstrap.cc:654] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:02.470878 7957 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d08ab761c18f419d8314bc123c7c262a" } new_table_name: "default.Table_ecc7df46a94f444cbbff889c5e0a639c" modify_external_catalogs: true
W20260812 19:27:02.469820 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 44623.7us
W20260812 19:27:02.481208 8446 leader_election.cc:341] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 453a403d1c0b4b5c8dcd9b93c7cc9ea4
I20260812 19:27:02.482090 7954 master_service.cc:946] ReplaceTablet: received request to replace tablet 249da5c0bd73498bbfc8f41e7513a9d4 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:02.497175 8636 tablet_bootstrap.cc:492] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
W20260812 19:27:02.501389 7962 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet f7c9e6328b70417cbeecf31f318f9b61 consensus state has no leader
I20260812 19:27:02.509863 8869 raft_consensus.cc:482] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:02.510360 8869 raft_consensus.cc:504] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.512502 8869 leader_election.cc:288] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:02.516933 8494 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 164) took 1274 ms. Trace:
I20260812 19:27:02.517247 8494 rpcz_store.cc:276] 0812 19:27:01.242985 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.243170 (+ 185us) service_pool.cc:227] Handling call
0812 19:27:01.246227 (+ 3057us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:01.246451 (+ 224us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:02.223071 (+976620us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:02.488562 (+265491us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:02.516882 (+ 28320us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":72562}
I20260812 19:27:02.522464 9255 consensus_queue.cc:1035] T 818eae7a6645415e992c25565f7f3b5a P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:02.497596 8636 ts_tablet_manager.cc:1397] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.004s
I20260812 19:27:02.539588 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:02.541472 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:02.547255 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet bdc25879cf7c434b91591a7c7382cdb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet bdc25879cf7c434b91591a7c7382cdb0 already in progress: creating tablet
W20260812 19:27:02.547974 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 384506029b4e49639f87f6d7005fa0a9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 384506029b4e49639f87f6d7005fa0a9 already in progress: creating tablet
W20260812 19:27:02.544240 8446 leader_election.cc:341] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: eec275b2131d4848ae120d8a841a1cae
I20260812 19:27:02.587306 9037 rpcz_store.cc:276] 0812 19:27:00.033580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.033738 (+ 158us) service_pool.cc:227] Handling call
0812 19:27:02.404991 (+2371253us) ts_tablet_manager.cc:1145] Deleting tablet 249da5c0bd73498bbfc8f41e7513a9d4
0812 19:27:02.405069 (+ 78us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:02.405588 (+ 519us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2370549}
W20260812 19:27:02.593757 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 249da5c0bd73498bbfc8f41e7513a9d4 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 249da5c0bd73498bbfc8f41e7513a9d4 already in progress: creating tablet
W20260812 19:27:02.548650 8278 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.598s user 0.002s sys 0.001s
W20260812 19:27:02.595415 8278 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.645s user 0.002s sys 0.001s
W20260812 19:27:02.597283 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 647563us
I20260812 19:27:02.598424 9233 ts_tablet_manager.cc:1918] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:02.591881 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 162) took 2563 ms. Trace:
I20260812 19:27:02.601985 9037 rpcz_store.cc:276] 0812 19:27:00.028785 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.036356 (+ 7571us) service_pool.cc:227] Handling call
0812 19:27:02.589996 (+2553640us) ts_tablet_manager.cc:1145] Deleting tablet 5bce01fd81f04f23a8cddc3a7b5eae8f
0812 19:27:02.590183 (+ 187us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:02.591631 (+ 1448us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2552894}
W20260812 19:27:02.604151 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5bce01fd81f04f23a8cddc3a7b5eae8f already in progress: creating tablet
I20260812 19:27:02.606354 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 165) took 2321 ms. Trace:
I20260812 19:27:02.618016 9037 rpcz_store.cc:276] 0812 19:27:00.285162 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.285269 (+ 107us) service_pool.cc:227] Handling call
0812 19:27:02.605340 (+2320071us) ts_tablet_manager.cc:1145] Deleting tablet 2b04529031f04302846b39d585d74ad5
0812 19:27:02.605435 (+ 95us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:02.606285 (+ 850us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2319445}
I20260812 19:27:02.645008 8623 tablet_bootstrap.cc:492] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:02.645545 8623 ts_tablet_manager.cc:1397] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.411s user 0.011s sys 0.002s
W20260812 19:27:02.568619 8326 consensus_meta.cc:287] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7: Time spent flushing consensus metadata: real 0.738s user 0.006s sys 0.014s
W20260812 19:27:02.650823 8107 consensus_peers.cc:487] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:02.659287 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_b8f8f3637e9344998414afa9cf1f2d45"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:02.661027 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b8f8f3637e9344998414afa9cf1f2d45 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:02.667382 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_65e0e363703e439ea5476db643057688"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:02.669674 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_65e0e363703e439ea5476db643057688 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:27:02.760919 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 2b04529031f04302846b39d585d74ad5 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 2b04529031f04302846b39d585d74ad5 already in progress: creating tablet
I20260812 19:27:02.785490 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_1ffdf4360f8748df9e45c5b04dc093e5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:02.787032 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_1ffdf4360f8748df9e45c5b04dc093e5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:02.788841 7952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_c30c4f84e6034b5f84410839aeafaef4" } new_table_name: "default.Table_6c98a9b63da5451ba194086ad4db81f6" modify_external_catalogs: true
I20260812 19:27:02.800638 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 164) took 2515 ms. Trace:
I20260812 19:27:02.801084 9037 rpcz_store.cc:276] 0812 19:27:00.284843 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.285801 (+ 958us) service_pool.cc:227] Handling call
0812 19:27:02.777243 (+2491442us) ts_tablet_manager.cc:1145] Deleting tablet a84bf28a3e174f3b88f8758b09ced1f1
0812 19:27:02.779821 (+ 2578us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:02.800553 (+ 20732us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2475964}
W20260812 19:27:02.802819 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet a84bf28a3e174f3b88f8758b09ced1f1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a84bf28a3e174f3b88f8758b09ced1f1 already in progress: creating tablet
I20260812 19:27:02.804836 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 166) took 2290 ms. Trace:
I20260812 19:27:02.805141 9037 rpcz_store.cc:276] 0812 19:27:00.514319 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.514466 (+ 147us) service_pool.cc:227] Handling call
0812 19:27:02.802018 (+2287552us) ts_tablet_manager.cc:1145] Deleting tablet 544d3d74baa6477da11abbee139ee66f
0812 19:27:02.804374 (+ 2356us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:02.804779 (+ 405us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2287001}
W20260812 19:27:02.806689 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 544d3d74baa6477da11abbee139ee66f because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 544d3d74baa6477da11abbee139ee66f already in progress: creating tablet
I20260812 19:27:02.816547 9037 tablet_replica.cc:330] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:02.818742 8326 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 182) took 1228 ms. Trace:
I20260812 19:27:02.823328 8326 rpcz_store.cc:276] 0812 19:27:01.590189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.598235 (+ 8046us) service_pool.cc:227] Handling call
0812 19:27:01.600875 (+ 2640us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:01.601072 (+ 197us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:01.829503 (+228431us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:02.781819 (+952316us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:02.818638 (+ 36819us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:02.599900 8516 raft_consensus.cc:3037] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:02.744429 9277 tablet.cc:1722] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:27:02.774605 8443 leader_election.cc:302] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:02.861636 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 87237.8us
I20260812 19:27:02.874204 8627 tablet_bootstrap.cc:492] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:02.874773 8627 ts_tablet_manager.cc:1397] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 1.301s user 0.004s sys 0.021s
I20260812 19:27:02.877483 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "133d0846cf1244cf91775af0b1ae9118" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:02.625959 8636 raft_consensus.cc:348] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.886705 8636 raft_consensus.cc:374] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:02.887012 8636 raft_consensus.cc:729] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:02.879604 9182 raft_consensus.cc:482] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:02.764215 9274 tablet.cc:1722] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:27:02.893093 9182 raft_consensus.cc:504] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.894996 9182 leader_election.cc:288] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:02.895315 7945 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111) [suppressed 4 similar messages]
I20260812 19:27:02.895383 9277 tablet.cc:1722] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:27:02.898685 8636 consensus_queue.cc:260] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.913641 9233 log.cc:1196] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/69fe5774f8dc46308954e9be54bd92b2
I20260812 19:27:02.914484 9233 ts_tablet_manager.cc:1939] T 69fe5774f8dc46308954e9be54bd92b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:02.917065 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e03513e6d6bc4e7ba5dfc355ccc0cb0f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:02.925450 9274 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33126 (request call id 216) took 1166 ms. Trace:
I20260812 19:27:02.925885 9274 rpcz_store.cc:276] 0812 19:27:01.759326 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.759511 (+ 185us) service_pool.cc:227] Handling call
0812 19:27:02.925385 (+1165874us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:01.764668 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0812 19:27:01.765528 (+ 860us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0812 19:27:01.816293 (+ 50765us) alter_schema_op.cc:65] Acquired schema lock
0812 19:27:01.816385 (+ 92us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0812 19:27:01.816690 (+ 305us) alter_schema_op.cc:126] START. Timestamp: 1786562821816422
0812 19:27:01.816722 (+ 32us) op_driver.cc:331] REPLICATION: starting
0812 19:27:01.823219 (+ 6497us) log.cc:842] Serialized 173 byte log entry
0812 19:27:02.633146 (+809927us) op_driver.cc:444] REPLICATION: finished
0812 19:27:02.764000 (+130854us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0812 19:27:02.894253 (+130253us) log.cc:842] Serialized 5 byte log entry
0812 19:27:02.918610 (+ 24357us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:02.924589 (+ 5979us) log.cc:842] Serialized 14 byte log entry
0812 19:27:02.925242 (+ 653us) alter_schema_op.cc:71] Released schema lock
0812 19:27:02.925271 (+ 29us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":130522,"prepare.queue_time_us":3480,"prepare.run_cpu_time_us":5856,"prepare.run_wall_time_us":332166,"raft.queue_time_us":1273,"raft.run_cpu_time_us":1371,"raft.run_wall_time_us":1371,"replication_time_us":816279,"thread_start_us":333188,"threads_started":3,"wal-append.queue_time_us":210944}]]}
I20260812 19:27:02.934027 8623 raft_consensus.cc:348] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.934808 8623 raft_consensus.cc:374] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:02.935077 8623 raft_consensus.cc:729] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:02.936980 8636 ts_tablet_manager.cc:1428] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.404s user 0.007s sys 0.000s
I20260812 19:27:02.940546 8636 tablet_bootstrap.cc:492] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:02.945343 9282 raft_consensus.cc:482] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:02.945968 9282 raft_consensus.cc:504] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:02.948807 9248 consensus_queue.cc:1035] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:02.960209 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_87cb1dcf475941269e6d752d00e0df9b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:02.969015 7957 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 8c9d071f07e5410d9e660986ab6858ef has no consensus state
I20260812 19:27:02.991923 9037 raft_consensus.cc:2229] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:02.992825 9037 raft_consensus.cc:2258] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:02.995204 9037 ts_tablet_manager.cc:1905] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:03.003391 9235 raft_consensus.cc:2726] T 818eae7a6645415e992c25565f7f3b5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:03.003870 9274 tablet.cc:1717] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Skipping requested alter to schema version 2, tablet already version 2
W20260812 19:27:03.014573 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 119272us
I20260812 19:27:03.026196 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 166) took 1389 ms. Trace:
I20260812 19:27:03.026683 9233 rpcz_store.cc:276] 0812 19:27:01.636511 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.639791 (+ 3280us) service_pool.cc:227] Handling call
0812 19:27:02.254937 (+615146us) ts_tablet_manager.cc:1145] Deleting tablet 69fe5774f8dc46308954e9be54bd92b2
0812 19:27:02.255057 (+ 120us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:02.574183 (+319126us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:02.598087 (+ 23904us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:03.026101 (+428014us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":614413}
I20260812 19:27:03.028443 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 167) took 1391 ms. Trace:
I20260812 19:27:03.028837 9233 rpcz_store.cc:276] 0812 19:27:01.636950 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.640001 (+ 3051us) service_pool.cc:227] Handling call
0812 19:27:03.028149 (+1388148us) ts_tablet_manager.cc:1145] Deleting tablet 68583d63475a495ca97f3221825622e2
0812 19:27:03.028198 (+ 49us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:03.028392 (+ 194us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1387490}
I20260812 19:27:03.033146 8623 consensus_queue.cc:260] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.035684 8623 ts_tablet_manager.cc:1428] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.390s user 0.005s sys 0.003s
I20260812 19:27:03.037328 8623 tablet_bootstrap.cc:492] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:03.066841 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e98e0f5b053649f1a5ab315312b37442" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:03.067476 8356 raft_consensus.cc:2454] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:03.077332 9233 tablet_replica.cc:330] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:03.078411 9233 raft_consensus.cc:2229] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:03.078948 9233 raft_consensus.cc:2258] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:03.031985 9282 leader_election.cc:288] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:02.909117 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d660422701a423794416b01cea825b4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:03.081372 8107 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:02.879905 9252 consensus_queue.cc:1035] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.182s
I20260812 19:27:02.879704 8108 leader_election.cc:302] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:27:03.083783 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 204170us
I20260812 19:27:03.084594 9252 raft_consensus.cc:2781] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:03.088166 9252 raft_consensus.cc:686] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:03.088954 9252 consensus_queue.cc:237] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.104308 9277 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:44966 (request call id 165) took 1469 ms. Trace:
I20260812 19:27:03.069866 9279 tablet.cc:1717] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Skipping requested alter to schema version 2, tablet already version 2
I20260812 19:27:03.108104 9274 tablet.cc:1722] T b00a037a2567470497e1a751754df345 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:27:03.042984 8636 tablet_bootstrap.cc:654] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:03.113219 9233 ts_tablet_manager.cc:1905] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:03.122004 8623 tablet_bootstrap.cc:654] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:03.059862 8323 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 174) took 1747 ms. Trace:
W20260812 19:27:03.065150 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_87cb1dcf475941269e6d752d00e0df9b in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:03.136474 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:03.138767 9277 rpcz_store.cc:276] 0812 19:27:01.635174 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.638405 (+ 3231us) service_pool.cc:227] Handling call
0812 19:27:03.104190 (+1465785us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:01.977585 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0812 19:27:01.978479 (+ 894us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0812 19:27:01.978547 (+ 68us) alter_schema_op.cc:65] Acquired schema lock
0812 19:27:01.978659 (+ 112us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0812 19:27:01.978878 (+ 219us) alter_schema_op.cc:126] START. Timestamp: 1786562821975836
0812 19:27:01.978933 (+ 55us) op_driver.cc:331] REPLICATION: starting
0812 19:27:01.979938 (+ 1005us) log.cc:842] Serialized 173 byte log entry
0812 19:27:02.860857 (+880919us) op_driver.cc:444] REPLICATION: finished
0812 19:27:02.895306 (+ 34449us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0812 19:27:02.947366 (+ 52060us) log.cc:842] Serialized 5 byte log entry
0812 19:27:03.097159 (+149793us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:03.102773 (+ 5614us) log.cc:842] Serialized 14 byte log entry
0812 19:27:03.103909 (+ 1136us) alter_schema_op.cc:71] Released schema lock
0812 19:27:03.103978 (+ 69us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":34285,"prepare.queue_time_us":332233,"prepare.run_cpu_time_us":9457,"prepare.run_wall_time_us":414914,"raft.queue_time_us":13278,"raft.run_cpu_time_us":16,"raft.run_wall_time_us":17,"replication_time_us":881838,"thread_start_us":702861,"threads_started":4,"wal-append.queue_time_us":314164}]]}
I20260812 19:27:03.147786 8636 tablet_bootstrap.cc:492] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:03.148201 8636 ts_tablet_manager.cc:1397] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.208s user 0.008s sys 0.000s
I20260812 19:27:03.150837 8636 raft_consensus.cc:348] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.151525 8636 raft_consensus.cc:374] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.151778 8636 raft_consensus.cc:729] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.152441 8636 consensus_queue.cc:260] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.157491 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 69fe5774f8dc46308954e9be54bd92b2 (table default.Table_4fce364e6d9545ae96b3b503b1fc5b71 [id=25842a7a7f6f400a867cc04b5ee0f2fd]) successfully deleted
W20260812 19:27:03.158214 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 68583d63475a495ca97f3221825622e2 because the tablet was not found. No further retry: Not found: Tablet not found: 68583d63475a495ca97f3221825622e2
I20260812 19:27:03.159546 7954 master_service.cc:946] ReplaceTablet: received request to replace tablet cfbf700d55a04b529507259406bdd5a1 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:03.125659 8323 rpcz_store.cc:276] 0812 19:27:01.312836 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.315004 (+ 2168us) service_pool.cc:227] Handling call
0812 19:27:01.336740 (+ 21736us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b5800001898. stack: 00007f865924a033 00007f8659249f30 00007f8658dcb534 00000000004db2b4 00000000004db249 00007f86590c0f11 00007f8659244851 00007f8659244702 00007f86620cfb09 00007f866112c730 00007f866120ed21 00007f86611ec1e3 00007f866119d869 00007f865f88fc44 00007f865f88fbd2 00007f865f88fb01
0812 19:27:01.454618 (+117878us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:01.454838 (+ 220us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:02.564292 (+1109454us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:03.059251 (+494959us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:03.059700 (+ 449us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35104640}
I20260812 19:27:03.102154 8627 raft_consensus.cc:348] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:03.172609 8627 raft_consensus.cc:374] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.172962 8627 raft_consensus.cc:729] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.173761 8627 consensus_queue.cc:260] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:03.200341 8636 ts_tablet_manager.cc:1428] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.052s user 0.006s sys 0.000s
I20260812 19:27:03.201526 8515 raft_consensus.cc:3037] T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:03.203290 8623 tablet_bootstrap.cc:492] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:03.203781 8623 ts_tablet_manager.cc:1397] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.167s user 0.010s sys 0.000s
I20260812 19:27:03.206045 8623 raft_consensus.cc:348] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.206722 8623 raft_consensus.cc:374] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.206964 8623 raft_consensus.cc:729] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.207505 8623 consensus_queue.cc:260] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.213043 8636 tablet_bootstrap.cc:492] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:03.213995 8623 ts_tablet_manager.cc:1428] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.010s user 0.004s sys 0.002s
I20260812 19:27:03.219224 8623 tablet_bootstrap.cc:492] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:03.233790 8623 tablet_bootstrap.cc:654] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:03.242151 7952 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 968eb13e27ea4f93a45aad17110b0ee4 consensus state has no leader
I20260812 19:27:03.253453 8623 tablet_bootstrap.cc:492] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:03.253873 8623 ts_tablet_manager.cc:1397] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.035s user 0.011s sys 0.000s
I20260812 19:27:03.256521 8623 raft_consensus.cc:348] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.257393 8623 raft_consensus.cc:374] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.257687 8623 raft_consensus.cc:729] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.258220 8636 tablet_bootstrap.cc:654] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:03.258451 8623 consensus_queue.cc:260] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.261611 8623 ts_tablet_manager.cc:1428] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 19:27:03.262696 8623 tablet_bootstrap.cc:492] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:03.278250 8623 tablet_bootstrap.cc:654] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:03.281152 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 968eb13e27ea4f93a45aad17110b0ee4 consensus state has no leader
I20260812 19:27:03.291105 8152 tablet_service.cc:1467] Processing CreateTablet for tablet 8c9d071f07e5410d9e660986ab6858ef (DEFAULT_TABLE table=default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.292337 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c9d071f07e5410d9e660986ab6858ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.296914 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 9f0afa2f3cee483facfbb2712917b829 (DEFAULT_TABLE table=default.Table_1068c7ccc7344a52934df17a65628581 [id=98f3d7d36ae249acac9dfe885cd2484e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.297914 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f0afa2f3cee483facfbb2712917b829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.300957 8156 tablet_service.cc:1467] Processing CreateTablet for tablet e6ef4b3497284a799d4a4f45d7609e45 (DEFAULT_TABLE table=default.Table_ed88cc07fe0945fd90987488667b3df3 [id=23f89cd2b66942daad6bee236f051c56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.301990 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ef4b3497284a799d4a4f45d7609e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.302004 8623 tablet_bootstrap.cc:492] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:03.302532 8623 ts_tablet_manager.cc:1397] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.004s
I20260812 19:27:03.303937 9233 ts_tablet_manager.cc:1918] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:03.304416 9233 log.cc:1196] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/756557a37a924bcf9d7c0743beed6a9d
I20260812 19:27:03.304965 8158 tablet_service.cc:1467] Processing CreateTablet for tablet 14e40943867249c58fee943fc8ed3fb0 (DEFAULT_TABLE table=default.Table_3171b7ca23df44969511a0a7255fadd7 [id=4b30c4ddd49445a4a6f56d5783a3021b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.306082 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e40943867249c58fee943fc8ed3fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.308908 8155 tablet_service.cc:1467] Processing CreateTablet for tablet b73ea5acf663420cbe9236c014d71199 (DEFAULT_TABLE table=default.Table_2e98d7b67f484dab9c439b8a37451d4d [id=5efb6efc9ea54166a35bbd1180ca4cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.309808 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73ea5acf663420cbe9236c014d71199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.306159 8623 raft_consensus.cc:348] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:03.317070 8623 raft_consensus.cc:374] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.317308 8623 raft_consensus.cc:729] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.317925 8623 consensus_queue.cc:260] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:03.321421 8623 ts_tablet_manager.cc:1428] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.019s user 0.006s sys 0.001s
I20260812 19:27:03.324738 8623 tablet_bootstrap.cc:492] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:03.332917 7955 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:03.335577 7955 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:03.336226 9233 ts_tablet_manager.cc:1939] T 756557a37a924bcf9d7c0743beed6a9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:03.339280 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 169) took 1701 ms. Trace:
I20260812 19:27:03.349362 8623 tablet_bootstrap.cc:654] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:03.176234 8627 ts_tablet_manager.cc:1428] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.301s user 0.007s sys 0.000s
W20260812 19:27:03.194075 8278 leader_election.cc:341] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:03.353016 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 158979us
W20260812 19:27:03.353682 8278 leader_election.cc:341] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.196938 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d660422701a423794416b01cea825b4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:03.357827 8443 leader_election.cc:341] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 453a403d1c0b4b5c8dcd9b93c7cc9ea4
I20260812 19:27:03.358253 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 867e426fedce4c9895b7b9a13f8bb5e3 (DEFAULT_TABLE table=default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.358395 8443 leader_election.cc:302] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:03.359473 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 867e426fedce4c9895b7b9a13f8bb5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.360174 8627 tablet_bootstrap.cc:492] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:03.360435 9282 raft_consensus.cc:2726] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:03.361546 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 5f3c6d8f74d044948a893d756be9a838 (DEFAULT_TABLE table=default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.285189 8326 tablet_service.cc:1467] Processing CreateTablet for tablet 9f0afa2f3cee483facfbb2712917b829 (DEFAULT_TABLE table=default.Table_1068c7ccc7344a52934df17a65628581 [id=98f3d7d36ae249acac9dfe885cd2484e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.362730 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f3c6d8f74d044948a893d756be9a838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.286058 8328 tablet_service.cc:1467] Processing CreateTablet for tablet e6ef4b3497284a799d4a4f45d7609e45 (DEFAULT_TABLE table=default.Table_ed88cc07fe0945fd90987488667b3df3 [id=23f89cd2b66942daad6bee236f051c56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.287631 8322 tablet_service.cc:1467] Processing CreateTablet for tablet 14e40943867249c58fee943fc8ed3fb0 (DEFAULT_TABLE table=default.Table_3171b7ca23df44969511a0a7255fadd7 [id=4b30c4ddd49445a4a6f56d5783a3021b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.341499 9248 raft_consensus.cc:482] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:03.370306 9248 raft_consensus.cc:504] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:03.359889 8443 leader_election.cc:302] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:03.372225 8443 leader_election.cc:341] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: eec275b2131d4848ae120d8a841a1cae
I20260812 19:27:03.344623 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 867e426fedce4c9895b7b9a13f8bb5e3 (DEFAULT_TABLE table=default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.372725 8443 leader_election.cc:302] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:03.346732 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 5f3c6d8f74d044948a893d756be9a838 (DEFAULT_TABLE table=default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.374045 9248 leader_election.cc:288] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:03.317915 8332 tablet_service.cc:1467] Processing CreateTablet for tablet b73ea5acf663420cbe9236c014d71199 (DEFAULT_TABLE table=default.Table_2e98d7b67f484dab9c439b8a37451d4d [id=5efb6efc9ea54166a35bbd1180ca4cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.375866 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30940fe1277e4347941f3525f6448cdb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:03.376641 8178 raft_consensus.cc:2454] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:03.377166 9284 raft_consensus.cc:2726] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:03.377894 9284 raft_consensus.cc:2726] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:03.378456 8281 leader_election.cc:302] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:03.379274 9248 raft_consensus.cc:2781] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:03.379684 9248 raft_consensus.cc:482] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:03.380075 9248 raft_consensus.cc:3037] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:03.379873 8443 leader_election.cc:302] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:03.381004 9282 raft_consensus.cc:2726] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:03.394438 8108 leader_election.cc:302] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:03.395251 9182 raft_consensus.cc:2781] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:03.395650 9182 raft_consensus.cc:482] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:03.396006 9182 raft_consensus.cc:3037] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:03.401652 7955 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 2 got 1
I20260812 19:27:03.402700 7955 catalog_manager.cc:5495] T eaaf04a85946447aa43873e3568aa3a3 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:03.403348 9182 raft_consensus.cc:504] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.405956 7955 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:03.406992 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e98e0f5b053649f1a5ab315312b37442" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:03.408545 8107 leader_election.cc:341] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.409404 9182 leader_election.cc:288] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:03.415033 8323 tablet_service.cc:1467] Processing CreateTablet for tablet 8c9d071f07e5410d9e660986ab6858ef (DEFAULT_TABLE table=default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.420678 8148 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff5b2d23d734217b0b10e50834b8883 (DEFAULT_TABLE table=default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.422312 8148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff5b2d23d734217b0b10e50834b8883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.339692 9233 rpcz_store.cc:276] 0812 19:27:01.637791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.645650 (+ 7859us) service_pool.cc:227] Handling call
0812 19:27:03.077098 (+1431448us) ts_tablet_manager.cc:1145] Deleting tablet 756557a37a924bcf9d7c0743beed6a9d
0812 19:27:03.077157 (+ 59us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:03.195236 (+118079us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:03.303680 (+108444us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:03.339208 (+ 35528us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1396429}
I20260812 19:27:03.423760 9233 tablet_replica.cc:330] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:03.431664 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff5b2d23d734217b0b10e50834b8883 (DEFAULT_TABLE table=default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.449059 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f0afa2f3cee483facfbb2712917b829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.451282 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 867e426fedce4c9895b7b9a13f8bb5e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.452983 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f3c6d8f74d044948a893d756be9a838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.454559 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73ea5acf663420cbe9236c014d71199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.455891 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e40943867249c58fee943fc8ed3fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.457973 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ef4b3497284a799d4a4f45d7609e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.459601 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff5b2d23d734217b0b10e50834b8883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.490760 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7d4a12b9c14415e8449d39663296450" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:03.485460 9248 raft_consensus.cc:504] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:03.503975 9233 raft_consensus.cc:2229] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:03.504731 9233 raft_consensus.cc:2258] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:03.512274 9312 tablet.cc:1722] T b00a037a2567470497e1a751754df345 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260812 19:27:03.514599 8108 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: Tablet not RUNNING: STOPPED
I20260812 19:27:03.515043 8108 leader_election.cc:302] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:03.515703 9307 raft_consensus.cc:2726] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:03.537997 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30940fe1277e4347941f3525f6448cdb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:03.538658 8178 raft_consensus.cc:3037] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:03.547004 8178 raft_consensus.cc:2454] T 30940fe1277e4347941f3525f6448cdb P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:03.548013 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c9d071f07e5410d9e660986ab6858ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.548280 8281 leader_election.cc:302] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:03.549346 9171 raft_consensus.cc:2781] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:03.563686 9248 leader_election.cc:288] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:03.620326 9171 raft_consensus.cc:686] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:03.625651 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e98e0f5b053649f1a5ab315312b37442" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:03.626471 8352 raft_consensus.cc:3037] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:03.559907 7959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 6da136cadb824d18886132c8f26ccb22
I20260812 19:27:03.628654 7959 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 220) took 2398 ms. Trace:
I20260812 19:27:03.628974 7959 rpcz_store.cc:276] 0812 19:27:01.230169 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.763850 (+533681us) service_pool.cc:227] Handling call
0812 19:27:01.782931 (+ 19081us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf466 00007f05ee9f0b34 00007f05ee9f0ac2 00007f05ee9f09f1 00007f05ee9f096c 00007f05ee9efc22 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:01.788533 (+ 5602us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:01.789235 (+ 702us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:27:01.789422 (+ 187us) catalog_manager.cc:2761] Locking tablets
0812 19:27:03.273000 (+1483578us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:27:03.559391 (+286391us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:27:03.559663 (+ 272us) catalog_manager.cc:2809] Committing in-memory state
0812 19:27:03.559806 (+ 143us) catalog_manager.cc:2813] Aborting table tasks
0812 19:27:03.628587 (+ 68781us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:03.277397 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:03.277768 (+ 371us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:03.277791 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:27:03.277803 (+ 12us) tablet.cc:660] Decoding operations
0812 19:27:03.278103 (+ 300us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:03.278141 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:03.278163 (+ 22us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:03.278445 (+ 282us) tablet.cc:699] Row locks acquired
0812 19:27:03.278459 (+ 14us) write_op.cc:260] PREPARE: finished
0812 19:27:03.278571 (+ 112us) write_op.cc:270] Start()
0812 19:27:03.278650 (+ 79us) write_op.cc:276] Timestamp: P: 1786562823278479 usec, L: 0
0812 19:27:03.278666 (+ 16us) op_driver.cc:331] REPLICATION: starting
0812 19:27:03.279171 (+ 505us) log.cc:842] Serialized 731 byte log entry
0812 19:27:03.555577 (+276406us) op_driver.cc:444] REPLICATION: finished
0812 19:27:03.555988 (+ 411us) write_op.cc:301] APPLY: starting
0812 19:27:03.556061 (+ 73us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:03.556241 (+ 180us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:03.556606 (+ 365us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:03.557039 (+ 433us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:03.557289 (+ 250us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:03.557376 (+ 87us) write_op.cc:312] APPLY: finished
0812 19:27:03.557692 (+ 316us) log.cc:842] Serialized 29 byte log entry
0812 19:27:03.557909 (+ 217us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:03.557999 (+ 90us) write_op.cc:454] Released schema lock
0812 19:27:03.558050 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:03.558327 (+ 277us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:03.558370 (+ 43us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10689,"spinlock_wait_cycles":41904896,"child_traces":[["op",{"apply.queue_time_us":198,"apply.run_cpu_time_us":2481,"apply.run_wall_time_us":2647,"num_ops":2,"prepare.queue_time_us":2791,"prepare.run_cpu_time_us":1972,"prepare.run_wall_time_us":1972,"replication_time_us":276771}]]}
I20260812 19:27:03.580943 7954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet cfbf700d55a04b529507259406bdd5a1
I20260812 19:27:03.633953 7954 catalog_manager.cc:6565] ReplaceTablet: tablet cfbf700d55a04b529507259406bdd5a1 deleted and replaced by tablet b1b85c19effd4cf78e9ae8c42c8dfe4b
I20260812 19:27:03.636562 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da136cadb824d18886132c8f26ccb22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:01 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:03.638414 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da136cadb824d18886132c8f26ccb22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:01 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:03.641026 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet cfbf700d55a04b529507259406bdd5a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b1b85c19effd4cf78e9ae8c42c8dfe4b) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:03.650108 9295 log.cc:924] Time spent T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.186s user 0.000s sys 0.001s
I20260812 19:27:03.652824 7955 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
W20260812 19:27:03.657639 8278 consensus_peers.cc:487] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:03.658727 8352 raft_consensus.cc:2454] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:03.637032 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet cfbf700d55a04b529507259406bdd5a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b1b85c19effd4cf78e9ae8c42c8dfe4b) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:03.624733 9171 consensus_queue.cc:237] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:03.661181 8108 leader_election.cc:302] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:03.662259 9310 raft_consensus.cc:2781] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:03.662775 9310 raft_consensus.cc:686] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:03.663630 9310 consensus_queue.cc:237] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.675575 9312 tablet.cc:1722] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
W20260812 19:27:03.667495 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 6da136cadb824d18886132c8f26ccb22 because the tablet was not found. No further retry: Not found: Tablet not found: 6da136cadb824d18886132c8f26ccb22
W20260812 19:27:03.680879 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet cfbf700d55a04b529507259406bdd5a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet cfbf700d55a04b529507259406bdd5a1 already in progress: creating tablet
I20260812 19:27:03.691075 9314 raft_consensus.cc:482] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:03.691891 9314 raft_consensus.cc:504] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.694383 8623 tablet_bootstrap.cc:492] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:03.694803 8623 ts_tablet_manager.cc:1397] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.372s user 0.033s sys 0.071s
I20260812 19:27:03.694919 8147 tablet_service.cc:1467] Processing CreateTablet for tablet d4d4e8d3d6ef40058b29f7cc574a5565 (DEFAULT_TABLE table=default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.696034 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d4e8d3d6ef40058b29f7cc574a5565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.696900 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:03.697620 8178 raft_consensus.cc:2454] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:03.698252 8623 raft_consensus.cc:348] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.698975 8281 leader_election.cc:302] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:03.699247 8623 raft_consensus.cc:374] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.699513 8623 raft_consensus.cc:729] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.699810 9314 leader_election.cc:288] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:03.700603 9314 raft_consensus.cc:2781] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:03.700281 8623 consensus_queue.cc:260] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.701128 9314 raft_consensus.cc:482] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:03.701835 9307 raft_consensus.cc:482] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:03.702292 9307 raft_consensus.cc:504] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.704836 9307 leader_election.cc:288] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:03.707554 9314 raft_consensus.cc:3037] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:03.703855 8623 ts_tablet_manager.cc:1428] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.009s user 0.009s sys 0.000s
I20260812 19:27:03.709758 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 8c9d071f07e5410d9e660986ab6858ef (DEFAULT_TABLE table=default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.709986 9233 ts_tablet_manager.cc:1905] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:03.710937 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8c9d071f07e5410d9e660986ab6858ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.716847 8623 tablet_bootstrap.cc:492] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:03.717742 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863e7ca808f54a989b3372aa4bfe361e" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:03.719323 8494 tablet_service.cc:1467] Processing CreateTablet for tablet 9f0afa2f3cee483facfbb2712917b829 (DEFAULT_TABLE table=default.Table_1068c7ccc7344a52934df17a65628581 [id=98f3d7d36ae249acac9dfe885cd2484e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.720369 8494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9f0afa2f3cee483facfbb2712917b829. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:03.720142 8107 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.723646 8486 tablet_service.cc:1467] Processing CreateTablet for tablet e6ef4b3497284a799d4a4f45d7609e45 (DEFAULT_TABLE table=default.Table_ed88cc07fe0945fd90987488667b3df3 [id=23f89cd2b66942daad6bee236f051c56]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.724965 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6ef4b3497284a799d4a4f45d7609e45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.725121 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863e7ca808f54a989b3372aa4bfe361e" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:03.730350 8482 tablet_service.cc:1467] Processing CreateTablet for tablet b73ea5acf663420cbe9236c014d71199 (DEFAULT_TABLE table=default.Table_2e98d7b67f484dab9c439b8a37451d4d [id=5efb6efc9ea54166a35bbd1180ca4cd0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.731801 8482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b73ea5acf663420cbe9236c014d71199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.731806 9316 tablet.cc:1717] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Skipping requested alter to schema version 2, tablet already version 2
I20260812 19:27:03.733297 8485 tablet_service.cc:1467] Processing CreateTablet for tablet 867e426fedce4c9895b7b9a13f8bb5e3 (DEFAULT_TABLE table=default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.734738 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 867e426fedce4c9895b7b9a13f8bb5e3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:03.735505 8108 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.736032 8108 leader_election.cc:302] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:03.737313 9182 raft_consensus.cc:2726] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:03.738756 8623 tablet_bootstrap.cc:654] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:03.759902 8327 tablet_service.cc:1467] Processing CreateTablet for tablet d4d4e8d3d6ef40058b29f7cc574a5565 (DEFAULT_TABLE table=default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.761067 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d4e8d3d6ef40058b29f7cc574a5565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.761169 9314 raft_consensus.cc:504] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.761546 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 94407c13a91c4a76bd3aa1c1c8032384 (DEFAULT_TABLE table=default.Table_771c0d6e0724423f812f274ab0c28078 [id=0e04666fe6ae47579191d2aebbfdc45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.762550 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94407c13a91c4a76bd3aa1c1c8032384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.765650 8623 tablet_bootstrap.cc:492] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:03.766059 8623 ts_tablet_manager.cc:1397] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.049s user 0.013s sys 0.000s
I20260812 19:27:03.768296 9182 raft_consensus.cc:482] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:03.768635 8623 raft_consensus.cc:348] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.769301 8623 raft_consensus.cc:374] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.768710 9182 raft_consensus.cc:504] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.769572 8623 raft_consensus.cc:729] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.770184 8623 consensus_queue.cc:260] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.773123 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249da5c0bd73498bbfc8f41e7513a9d4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:03.774865 8108 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.775205 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 6ff5b2d23d734217b0b10e50834b8883 (DEFAULT_TABLE table=default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.775801 9182 leader_election.cc:288] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:03.778456 8493 tablet_service.cc:1467] Processing CreateTablet for tablet d4d4e8d3d6ef40058b29f7cc574a5565 (DEFAULT_TABLE table=default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.778411 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:03.779239 8178 raft_consensus.cc:3037] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:03.790191 8178 raft_consensus.cc:2454] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:03.792514 8281 leader_election.cc:302] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:03.793361 9248 raft_consensus.cc:2781] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:03.784106 8623 ts_tablet_manager.cc:1428] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260812 19:27:03.801079 8623 tablet_bootstrap.cc:492] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:03.808100 9248 raft_consensus.cc:686] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:03.809077 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ff5b2d23d734217b0b10e50834b8883. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.809911 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d4d4e8d3d6ef40058b29f7cc574a5565. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.809545 9248 consensus_queue.cc:237] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.817869 8495 tablet_service.cc:1467] Processing CreateTablet for tablet 5f3c6d8f74d044948a893d756be9a838 (DEFAULT_TABLE table=default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.819022 8495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f3c6d8f74d044948a893d756be9a838. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.820173 8623 tablet_bootstrap.cc:654] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:03.822535 9314 leader_election.cc:288] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:03.839452 8623 tablet_bootstrap.cc:492] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:03.839996 8623 ts_tablet_manager.cc:1397] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.039s user 0.010s sys 0.000s
I20260812 19:27:03.815900 9282 raft_consensus.cc:482] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:03.852430 8623 raft_consensus.cc:348] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.853164 8623 raft_consensus.cc:374] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.853547 8623 raft_consensus.cc:729] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.856086 8483 tablet_service.cc:1467] Processing CreateTablet for tablet 14e40943867249c58fee943fc8ed3fb0 (DEFAULT_TABLE table=default.Table_3171b7ca23df44969511a0a7255fadd7 [id=4b30c4ddd49445a4a6f56d5783a3021b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:03.857486 8483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 14e40943867249c58fee943fc8ed3fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:03.857767 8623 consensus_queue.cc:260] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.859809 8623 ts_tablet_manager.cc:1428] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.019s user 0.004s sys 0.000s
I20260812 19:27:03.860594 8623 tablet_bootstrap.cc:492] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:03.831970 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30940fe1277e4347941f3525f6448cdb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:03.868557 8512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249da5c0bd73498bbfc8f41e7513a9d4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:03.852864 9282 raft_consensus.cc:504] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:03.870702 8107 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.871094 8107 leader_election.cc:302] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:03.872048 9182 raft_consensus.cc:2726] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:03.873659 9282 leader_election.cc:288] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:03.874851 9282 raft_consensus.cc:482] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:03.875387 9282 raft_consensus.cc:504] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:03.877275 8446 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 6f7cfdcedbaf4db7b510dd8e9f5ae867
W20260812 19:27:03.881422 8278 leader_election.cc:341] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.882288 8623 tablet_bootstrap.cc:654] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:03.877756 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30940fe1277e4347941f3525f6448cdb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:03.884995 8278 leader_election.cc:341] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.878820 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:03.842615 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:03.891093 9182 raft_consensus.cc:482] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:03.887974 8278 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.891597 9182 raft_consensus.cc:504] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:03.892668 8278 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.894948 9182 leader_election.cc:288] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:03.896996 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22fe32c0d82845b8a9f0c0e4d88f7d39" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:03.898594 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22fe32c0d82845b8a9f0c0e4d88f7d39" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:03.898849 8107 leader_election.cc:341] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:03.899180 8355 raft_consensus.cc:2454] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:03.901618 8108 leader_election.cc:302] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:03.902809 9307 raft_consensus.cc:2781] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:03.903152 9307 raft_consensus.cc:482] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:03.903440 9307 raft_consensus.cc:3037] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:03.916002 8446 leader_election.cc:341] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 4dc5602ff1c24b6ab561389031d89885
W20260812 19:26:57.141523 9061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:03.863292 8443 leader_election.cc:302] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:03.925458 9062 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260812 19:27:03.913946 8623 tablet_bootstrap.cc:492] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:03.926050 8623 ts_tablet_manager.cc:1397] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.066s user 0.012s sys 0.000s
I20260812 19:27:03.926234 8849 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260812 19:27:03.929908 8623 raft_consensus.cc:348] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.930557 8623 raft_consensus.cc:374] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:03.930991 9284 raft_consensus.cc:2726] T b7d4a12b9c14415e8449d39663296450 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:26:57.015409 9059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:03.932576 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 89383.2us
I20260812 19:27:03.933921 8849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:27:03.933365 9282 leader_election.cc:288] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:03.949642 8849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:27:03.930783 8623 raft_consensus.cc:729] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:03.951329 8623 consensus_queue.cc:260] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.953219 8849 hybrid_clock.cc:648] HybridClock initialized: now 1786562823953132 us; error 94 us; skew 500 ppm
I20260812 19:27:03.954365 8849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:03.958926 8623 ts_tablet_manager.cc:1428] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.033s user 0.006s sys 0.000s
I20260812 19:27:03.959823 8623 tablet_bootstrap.cc:492] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:03.960157 8636 thread.cc:636] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.693s user 0.001s sys 0.003s
W20260812 19:27:03.961903 8636 thread.cc:602] log-alloc [worker] (thread pool) Time spent starting thread: real 0.695s user 0.002s sys 0.003s
W20260812 19:27:03.965351 9308 log.cc:924] Time spent T d49351be8d2a40109d88b54db11c4489 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.503s user 0.001s sys 0.000s
I20260812 19:27:03.979812 8623 tablet_bootstrap.cc:654] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:03.985543 8154 consensus_meta.cc:287] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.588s user 0.005s sys 0.000s
I20260812 19:27:03.963203 9307 raft_consensus.cc:504] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:03.988898 8849 webserver.cc:460] Webserver started at http://127.7.144.253:39161/ using document root <none> and password file <none>
W20260812 19:27:03.959633 8443 leader_election.cc:341] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:27:03.990556 8443 leader_election.cc:302] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:03.991482 8849 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:03.991801 8849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:03.992419 9284 raft_consensus.cc:2726] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:03.994410 9307 leader_election.cc:288] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:03.995234 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22fe32c0d82845b8a9f0c0e4d88f7d39" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:03.995548 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22fe32c0d82845b8a9f0c0e4d88f7d39" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:03.996105 8352 raft_consensus.cc:3037] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:04.006453 7958 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
W20260812 19:27:04.014607 7958 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 36) took 1840 ms (client timeout 1000 ms). Trace:
W20260812 19:27:04.014981 7958 rpcz_store.cc:269] 0812 19:27:02.174366 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:02.174645 (+ 279us) service_pool.cc:227] Handling call
0812 19:27:04.014526 (+1839881us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":3}
W20260812 19:27:04.001770 8443 leader_election.cc:341] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 4dc5602ff1c24b6ab561389031d89885
I20260812 19:27:04.027709 8443 leader_election.cc:302] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:04.041234 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:04.043632 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:04.045269 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 2 got 1
I20260812 19:27:04.046187 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:04.047169 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:04.052472 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 756557a37a924bcf9d7c0743beed6a9d (table default.Table_9f6c648486734773bac487f03209f60b [id=c04a06245afc4bc39447bcb6ca5940af]) successfully deleted
I20260812 19:27:03.978793 8636 tablet_bootstrap.cc:492] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:04.061558 8636 ts_tablet_manager.cc:1397] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.849s user 0.011s sys 0.003s
I20260812 19:27:04.062103 9323 raft_consensus.cc:2726] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:04.066314 8849 fs_manager.cc:709] Time spent opening directory manager: real 0.037s user 0.006s sys 0.006s
I20260812 19:27:04.067211 7958 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_a144bda50c444fd987ca9dbe9d6458b2" } new_table_name: "default.Table_fefff8bc40ae422b9363d2750dd22382" modify_external_catalogs: true
I20260812 19:27:04.124992 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 6da136cadb824d18886132c8f26ccb22 (DEFAULT_TABLE table=default.Table_0522318c18b84a738b8fb434656e38eb [id=a094ce64db3b49fe98460945e615b546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.126260 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da136cadb824d18886132c8f26ccb22. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:03.995874 8158 consensus_meta.cc:287] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.578s user 0.006s sys 0.001s
W20260812 19:27:03.996537 8107 leader_election.cc:341] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.027067 8623 tablet_bootstrap.cc:492] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
W20260812 19:27:04.128504 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 131993us
I20260812 19:27:04.128676 8623 ts_tablet_manager.cc:1397] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.169s user 0.012s sys 0.000s
I20260812 19:27:04.131358 8623 raft_consensus.cc:348] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.132210 8623 raft_consensus.cc:374] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:04.132531 8623 raft_consensus.cc:729] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:04.133381 8623 consensus_queue.cc:260] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.135833 8623 ts_tablet_manager.cc:1428] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260812 19:27:04.137125 8623 tablet_bootstrap.cc:492] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:04.051837 8155 consensus_meta.cc:287] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.659s user 0.006s sys 0.000s
I20260812 19:27:04.140165 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_33d1abe4f7ee45e4a2d97cc132d24e07"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:04.142122 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:04.143749 7959 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_916f8c0b79394ffc9e296b898a1f93ec"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:04.145305 7959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_916f8c0b79394ffc9e296b898a1f93ec in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:04.146490 7952 master_service.cc:946] ReplaceTablet: received request to replace tablet 133d0846cf1244cf91775af0b1ae9118 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:04.146963 7953 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_82549cc5780a4115ac93fa50541bd102" } new_table_name: "default.Table_495da693476b4874bb497da7998bf531" modify_external_catalogs: true
I20260812 19:27:04.147337 8623 tablet_bootstrap.cc:654] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:04.148705 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet 6da136cadb824d18886132c8f26ccb22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:01 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:27:04.149716 8152 consensus_meta.cc:287] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.551s user 0.006s sys 0.000s
I20260812 19:27:04.004189 9037 ts_tablet_manager.cc:1918] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:04.004382 8352 raft_consensus.cc:2454] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:04.158118 9037 log.cc:1196] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/7d660422701a423794416b01cea825b4
I20260812 19:27:04.037943 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 94407c13a91c4a76bd3aa1c1c8032384 (DEFAULT_TABLE table=default.Table_771c0d6e0724423f812f274ab0c28078 [id=0e04666fe6ae47579191d2aebbfdc45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.159116 9037 ts_tablet_manager.cc:1939] T 7d660422701a423794416b01cea825b4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:04.159931 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 167) took 3600 ms. Trace:
I20260812 19:27:04.160208 9037 rpcz_store.cc:276] 0812 19:27:00.559247 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:00.559399 (+ 152us) service_pool.cc:227] Handling call
0812 19:27:02.805891 (+2246492us) ts_tablet_manager.cc:1145] Deleting tablet 7d660422701a423794416b01cea825b4
0812 19:27:02.816334 (+ 10443us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:03.461539 (+645205us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.003952 (+542413us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.159880 (+155928us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":174228,"tablet-delete.queue_time_us":2245920}
I20260812 19:27:04.161566 8108 leader_election.cc:302] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:04.162122 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94407c13a91c4a76bd3aa1c1c8032384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.162565 9310 raft_consensus.cc:482] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:04.162949 9310 raft_consensus.cc:504] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.163827 9307 raft_consensus.cc:2781] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:04.165828 9310 leader_election.cc:288] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:04.166712 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:04.167514 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:04.167896 8108 leader_election.cc:341] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.024417 8627 tablet_bootstrap.cc:654] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:04.171370 8107 leader_election.cc:341] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.172037 8107 leader_election.cc:302] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:04.179417 8155 tablet_service.cc:1467] Processing CreateTablet for tablet a91c4d5adb3d4f97939e38e9cee79532 (DEFAULT_TABLE table=default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.180735 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91c4d5adb3d4f97939e38e9cee79532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.182179 9255 raft_consensus.cc:2726] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:04.199404 9307 raft_consensus.cc:686] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:04.200734 9307 consensus_queue.cc:237] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.255786 7956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet f57f252b520945328fdaaa9adef593a1
I20260812 19:27:04.257555 7956 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 224) took 1795 ms. Trace:
I20260812 19:27:04.257851 7956 rpcz_store.cc:276] 0812 19:27:02.462339 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:02.462802 (+ 463us) service_pool.cc:227] Handling call
0812 19:27:02.465649 (+ 2847us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:02.466240 (+ 591us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:27:02.466386 (+ 146us) catalog_manager.cc:2761] Locking tablets
0812 19:27:03.280632 (+814246us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:27:03.588146 (+307514us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:27:03.588407 (+ 261us) catalog_manager.cc:2809] Committing in-memory state
0812 19:27:04.255640 (+667233us) catalog_manager.cc:2813] Aborting table tasks
0812 19:27:04.257493 (+ 1853us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:03.323373 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:03.323738 (+ 365us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:03.323762 (+ 24us) write_op.cc:435] Acquired schema lock
0812 19:27:03.323918 (+ 156us) tablet.cc:660] Decoding operations
0812 19:27:03.324241 (+ 323us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:03.324311 (+ 70us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:03.324337 (+ 26us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:03.324633 (+ 296us) tablet.cc:699] Row locks acquired
0812 19:27:03.324650 (+ 17us) write_op.cc:260] PREPARE: finished
0812 19:27:03.324758 (+ 108us) write_op.cc:270] Start()
0812 19:27:03.324855 (+ 97us) write_op.cc:276] Timestamp: P: 1786562823324659 usec, L: 0
0812 19:27:03.324872 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:27:03.325424 (+ 552us) log.cc:842] Serialized 762 byte log entry
0812 19:27:03.575563 (+250139us) op_driver.cc:444] REPLICATION: finished
0812 19:27:03.578970 (+ 3407us) write_op.cc:301] APPLY: starting
0812 19:27:03.579030 (+ 60us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:03.579216 (+ 186us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:03.579353 (+ 137us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:03.579676 (+ 323us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:03.579933 (+ 257us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:03.580013 (+ 80us) write_op.cc:312] APPLY: finished
0812 19:27:03.587032 (+ 7019us) log.cc:842] Serialized 29 byte log entry
0812 19:27:03.587757 (+ 725us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:03.587886 (+ 129us) write_op.cc:454] Released schema lock
0812 19:27:03.587932 (+ 46us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:03.588569 (+ 637us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:03.588602 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":3230,"apply.run_cpu_time_us":2269,"apply.run_wall_time_us":9859,"num_ops":2,"prepare.queue_time_us":41031,"prepare.run_cpu_time_us":2038,"prepare.run_wall_time_us":2249,"replication_time_us":250591}]]}
W20260812 19:27:04.279436 7958 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet df369d3c4e004c29ac65c5ecf7f8c4cc consensus state has no leader
I20260812 19:27:04.285643 9335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:27:04.285432 8152 tablet_service.cc:1467] Processing CreateTablet for tablet 69ca59e00b52437a8d7ef06ebc194af3 (DEFAULT_TABLE table=default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:27:04.294917 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 52652.8us
W20260812 19:27:04.295346 8148 consensus_meta.cc:287] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.617s user 0.008s sys 0.000s
I20260812 19:27:04.296667 8849 fs_manager.cc:725] Time spent opening block manager: real 0.225s user 0.016s sys 0.052s
I20260812 19:27:04.296981 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet f57f252b520945328fdaaa9adef593a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:02 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:04.297446 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ca59e00b52437a8d7ef06ebc194af3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:04.298350 7948 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7764a1ae009142b29d5fb574dca45e21 consensus state has no leader
I20260812 19:27:04.297190 8849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
format_stamp: "Formatted at 2026-08-12 19:26:35 on dist-test-slave-0b58"
W20260812 19:27:04.309067 8330 consensus_meta.cc:287] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7: Time spent flushing consensus metadata: real 0.518s user 0.006s sys 0.000s
I20260812 19:27:04.323863 9307 raft_consensus.cc:482] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:04.324283 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet f57f252b520945328fdaaa9adef593a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f57f252b520945328fdaaa9adef593a1 already in progress: creating tablet
I20260812 19:27:04.324517 9307 raft_consensus.cc:504] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.328135 9307 leader_election.cc:288] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:04.328706 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:04.307296 8849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:04.330250 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:04.331009 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet da5f9e7431654d5fbae5d554c6f14569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:04.332499 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 4dc5602ff1c24b6ab561389031d89885 because the tablet was not found. No further retry: Not found: Tablet not found: 4dc5602ff1c24b6ab561389031d89885
W20260812 19:27:04.334053 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet eec275b2131d4848ae120d8a841a1cae because the tablet was not found. No further retry: Not found: Tablet not found: eec275b2131d4848ae120d8a841a1cae
I20260812 19:27:04.338224 9342 tablet_replica.cc:330] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:04.339223 9342 raft_consensus.cc:2229] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:04.339311 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:04.339821 9342 raft_consensus.cc:2258] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:04.341786 9342 ts_tablet_manager.cc:1905] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:04.343675 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:04.348925 7955 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 30) took 2584 ms (client timeout 1000 ms). Trace:
W20260812 19:27:04.350824 7955 rpcz_store.cc:269] 0812 19:27:01.764077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.766459 (+ 2382us) service_pool.cc:227] Handling call
0812 19:27:02.067186 (+300727us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:04.004470 (+1937284us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:04.004503 (+ 33us) write_op.cc:454] Released schema lock
0812 19:27:04.348835 (+344332us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:03.683199 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:03.683554 (+ 355us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:03.683579 (+ 25us) write_op.cc:435] Acquired schema lock
0812 19:27:03.683592 (+ 13us) tablet.cc:660] Decoding operations
0812 19:27:03.683854 (+ 262us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:03.683892 (+ 38us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:03.683915 (+ 23us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:03.684055 (+ 140us) tablet.cc:699] Row locks acquired
0812 19:27:03.684067 (+ 12us) write_op.cc:260] PREPARE: finished
0812 19:27:03.684175 (+ 108us) write_op.cc:270] Start()
0812 19:27:03.684290 (+ 115us) write_op.cc:276] Timestamp: P: 1786562823684046 usec, L: 0
0812 19:27:03.684307 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:27:03.684827 (+ 520us) log.cc:842] Serialized 533 byte log entry
0812 19:27:03.794823 (+109996us) op_driver.cc:444] REPLICATION: finished
0812 19:27:03.796977 (+ 2154us) write_op.cc:301] APPLY: starting
0812 19:27:03.797048 (+ 71us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:03.797194 (+ 146us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:03.797318 (+ 124us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:03.797603 (+ 285us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:03.797790 (+ 187us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:03.797855 (+ 65us) write_op.cc:312] APPLY: finished
0812 19:27:03.798085 (+ 230us) log.cc:842] Serialized 23 byte log entry
0812 19:27:03.798914 (+ 829us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:03.799001 (+ 87us) write_op.cc:454] Released schema lock
0812 19:27:03.799044 (+ 43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":30221,"reported_tablets":21,"spinlock_wait_cycles":96147840,"child_traces":[["op",{"apply.queue_time_us":394,"apply.run_cpu_time_us":1779,"apply.run_wall_time_us":2407,"num_ops":1,"prepare.queue_time_us":102,"prepare.run_cpu_time_us":1959,"prepare.run_wall_time_us":4179,"raft.queue_time_us":391,"raft.run_cpu_time_us":898,"raft.run_wall_time_us":897,"replication_time_us":110417}]]}
I20260812 19:27:04.355221 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_d919a6bee2304ccab308b3d08e5be52c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:04.356240 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_51762252a63548a9bf108b1eed133662"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:04.358086 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_51762252a63548a9bf108b1eed133662 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:04.358251 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 169) took 3219 ms. Trace:
W20260812 19:27:04.356745 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_d919a6bee2304ccab308b3d08e5be52c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:04.358574 9037 rpcz_store.cc:276] 0812 19:27:01.139051 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.139615 (+ 564us) service_pool.cc:227] Handling call
0812 19:27:04.300141 (+3160526us) ts_tablet_manager.cc:1145] Deleting tablet 58149ab874b44f63b01ea611814e1417
0812 19:27:04.357854 (+ 57713us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:04.358193 (+ 339us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3159994}
I20260812 19:27:04.361480 9307 consensus_queue.cc:1035] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:04.371299 8623 tablet_bootstrap.cc:492] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:04.371817 8623 ts_tablet_manager.cc:1397] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.235s user 0.024s sys 0.063s
W20260812 19:27:04.381675 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 379719us
I20260812 19:27:04.387876 8623 raft_consensus.cc:348] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.393224 8623 raft_consensus.cc:374] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:04.393558 8623 raft_consensus.cc:729] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:04.394256 8623 consensus_queue.cc:260] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:04.359251 9171 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s user 0.070s sys 0.106s
I20260812 19:27:04.397346 8623 ts_tablet_manager.cc:1428] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.024s user 0.005s sys 0.000s
I20260812 19:27:04.398252 8623 tablet_bootstrap.cc:492] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:04.401578 8636 raft_consensus.cc:348] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.402530 8636 raft_consensus.cc:374] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:04.402799 8636 raft_consensus.cc:729] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:04.403226 8623 tablet_bootstrap.cc:654] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:04.403138 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 35) took 1850 ms (client timeout 1000 ms). Trace:
W20260812 19:27:04.403447 7960 rpcz_store.cc:269] 0812 19:27:02.552684 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:02.552845 (+ 161us) service_pool.cc:227] Handling call
0812 19:27:04.403055 (+1850210us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":93918,"reported_tablets":21}
I20260812 19:27:04.403445 8636 consensus_queue.cc:260] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.405776 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 7d660422701a423794416b01cea825b4 (table default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]) successfully deleted
I20260812 19:27:04.406545 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 6da136cadb824d18886132c8f26ccb22 (DEFAULT_TABLE table=default.Table_0522318c18b84a738b8fb434656e38eb [id=a094ce64db3b49fe98460945e615b546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.409302 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da136cadb824d18886132c8f26ccb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.310518 8326 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 189) took 1018 ms. Trace:
I20260812 19:27:04.411419 8492 tablet_service.cc:1467] Processing CreateTablet for tablet 94407c13a91c4a76bd3aa1c1c8032384 (DEFAULT_TABLE table=default.Table_771c0d6e0724423f812f274ab0c28078 [id=0e04666fe6ae47579191d2aebbfdc45b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.411759 8481 tablet_service.cc:1467] Processing CreateTablet for tablet 69ca59e00b52437a8d7ef06ebc194af3 (DEFAULT_TABLE table=default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.412567 8487 tablet_service.cc:1514] Processing DeleteTablet for tablet cfbf700d55a04b529507259406bdd5a1 with delete_type TABLET_DATA_DELETED (replaced by tablet b1b85c19effd4cf78e9ae8c42c8dfe4b) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:04.412983 8480 tablet_service.cc:1514] Processing DeleteTablet for tablet f57f252b520945328fdaaa9adef593a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:02 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:04.413800 8490 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:04.415109 8484 tablet_service.cc:1467] Processing CreateTablet for tablet 6da136cadb824d18886132c8f26ccb22 (DEFAULT_TABLE table=default.Table_0522318c18b84a738b8fb434656e38eb [id=a094ce64db3b49fe98460945e615b546]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.415006 8479 tablet_service.cc:1467] Processing CreateTablet for tablet a91c4d5adb3d4f97939e38e9cee79532 (DEFAULT_TABLE table=default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:27:04.405545 9171 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s user 0.071s sys 0.107s
I20260812 19:27:04.445437 7960 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3171b7ca23df44969511a0a7255fadd7" } modify_external_catalogs: true
I20260812 19:27:04.452286 8328 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 190) took 1168 ms. Trace:
W20260812 19:27:04.450220 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 58149ab874b44f63b01ea611814e1417 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 58149ab874b44f63b01ea611814e1417 already in progress: creating tablet
I20260812 19:27:04.446831 7960 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_3171b7ca23df44969511a0a7255fadd7" } modify_external_catalogs: true
I20260812 19:27:04.470633 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet f57f252b520945328fdaaa9adef593a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:02 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:04.471784 8333 tablet_service.cc:1467] Processing CreateTablet for tablet a91c4d5adb3d4f97939e38e9cee79532 (DEFAULT_TABLE table=default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.473141 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91c4d5adb3d4f97939e38e9cee79532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.494058 9307 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:04.494772 9307 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.453186 8328 rpcz_store.cc:276] 0812 19:27:03.284312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.285305 (+ 993us) service_pool.cc:227] Handling call
0812 19:27:03.363764 (+ 78459us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:03.364233 (+ 469us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:04.029479 (+665246us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.451766 (+422287us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:04.452195 (+ 429us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:04.502934 9307 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:04.505426 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:04.506935 8107 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.515576 9233 ts_tablet_manager.cc:1918] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:04.516335 9342 ts_tablet_manager.cc:1918] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:04.519721 9342 log.cc:1196] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/da5f9e7431654d5fbae5d554c6f14569
I20260812 19:27:04.521006 9342 ts_tablet_manager.cc:1939] T da5f9e7431654d5fbae5d554c6f14569 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:04.522113 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 69ca59e00b52437a8d7ef06ebc194af3 (DEFAULT_TABLE table=default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:04.523229 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ca59e00b52437a8d7ef06ebc194af3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:04.524750 7953 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 95e195a643084486a74be961177bf42c consensus state has no leader
I20260812 19:27:04.528152 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet da5f9e7431654d5fbae5d554c6f14569 (table default.Table_ad6af655b663482b88244d72f58c34c0 [id=a703135c7fcc446fba1a069bbf4c3b96]) successfully deleted
I20260812 19:27:04.528548 9342 tablet_replica.cc:330] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:04.529423 9342 raft_consensus.cc:2229] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:27:04.529398 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet dbafc01c482b493a981aed31ce112885 because the tablet was not found. No further retry: Not found: Tablet not found: dbafc01c482b493a981aed31ce112885
I20260812 19:27:04.530085 9342 pending_rounds.cc:62] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:27:04.530424 9342 pending_rounds.cc:68] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761323494244352 op_type: NO_OP noop_request { }
I20260812 19:27:04.530925 9342 raft_consensus.cc:2866] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:04.531358 9342 raft_consensus.cc:2258] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:04.537079 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 177) took 2952 ms. Trace:
I20260812 19:27:04.537786 9037 rpcz_store.cc:276] 0812 19:27:01.553206 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.553470 (+ 264us) service_pool.cc:227] Handling call
0812 19:27:04.361325 (+2807855us) ts_tablet_manager.cc:1145] Deleting tablet da5f9e7431654d5fbae5d554c6f14569
0812 19:27:04.396076 (+ 34751us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:04.505537 (+109461us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2807138}
W20260812 19:27:04.540843 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet da5f9e7431654d5fbae5d554c6f14569 because the tablet was not found. No further retry: Not found: Tablet not found: da5f9e7431654d5fbae5d554c6f14569
I20260812 19:27:04.453897 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa599b75d9e4f10b2cbed69b9b9c92b" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:04.545290 7953 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_62f170365c8247b1ab9704bfc9ec48dc" } modify_external_catalogs: true
I20260812 19:27:04.545974 7953 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_62f170365c8247b1ab9704bfc9ec48dc" } modify_external_catalogs: true
I20260812 19:27:04.554320 9037 tablet_replica.cc:330] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:27:04.558184 8322 consensus_meta.cc:287] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent flushing consensus metadata: real 0.817s user 0.004s sys 0.004s
I20260812 19:27:04.559199 8322 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 191) took 1272 ms. Trace:
I20260812 19:27:04.559604 8322 rpcz_store.cc:276] 0812 19:27:03.286727 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.286922 (+ 195us) service_pool.cc:227] Handling call
0812 19:27:03.368725 (+ 81803us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:03.368870 (+ 145us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:03.740793 (+371923us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.558725 (+817932us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:04.559146 (+ 421us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:04.417840 8326 rpcz_store.cc:276] 0812 19:27:03.283973 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.284475 (+ 502us) service_pool.cc:227] Handling call
0812 19:27:03.362521 (+ 78046us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:03.362682 (+ 161us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:03.611025 (+248343us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.093734 (+482709us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:04.302493 (+208759us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:04.562899 8107 consensus_peers.cc:487] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:04.567574 9310 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:04.568073 9310 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.569628 7952 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 133d0846cf1244cf91775af0b1ae9118
I20260812 19:27:04.570863 7952 catalog_manager.cc:6565] ReplaceTablet: tablet 133d0846cf1244cf91775af0b1ae9118 deleted and replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d
I20260812 19:27:04.540293 8636 ts_tablet_manager.cc:1428] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.478s user 0.000s sys 0.011s
W20260812 19:27:04.571666 8636 ts_tablet_manager.cc:1460] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5: Tablet startup took 509ms
I20260812 19:27:04.571614 7952 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ae44aac5695a468ba04978ae918c66b4" } new_table_name: "default.Table_1ba2cf16de96431e852a531d84346249" modify_external_catalogs: true
W20260812 19:27:04.571959 8636 ts_tablet_manager.cc:1462] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5: Trace:
0812 19:26:51.361590 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:51.404410 (+ 42820us) service_pool.cc:227] Handling call
0812 19:26:51.406962 (+ 2552us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:51.407145 (+ 183us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:51.705430 (+298285us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:51.729982 (+ 24552us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:51.730436 (+ 454us) inbound_call.cc:173] Queueing success response
0812 19:27:03.212742 (+11482306us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0812 19:27:04.061861 (+849119us) ts_tablet_manager.cc:1429] Starting tablet replica
0812 19:27:04.065384 (+ 3523us) tablet_replica.cc:259] Starting instrumentation
0812 19:27:04.065881 (+ 497us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":95033,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":291,"tablet-open.queue_time_us":11482367}
I20260812 19:27:04.573913 9233 log.cc:1196] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/017b6bfef5f44da0866917e04e2db072
I20260812 19:27:04.575814 9233 ts_tablet_manager.cc:1939] T 017b6bfef5f44da0866917e04e2db072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:04.576922 8478 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:04.577023 9037 raft_consensus.cc:2229] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:04.577567 9037 pending_rounds.cc:62] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Trying to abort 1 pending ops.
I20260812 19:27:04.577826 9037 pending_rounds.cc:68] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761314566959104 op_type: NO_OP noop_request { }
I20260812 19:27:04.578246 9037 raft_consensus.cc:2866] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:04.578611 9037 raft_consensus.cc:2258] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:04.579099 8493 consensus_meta.cc:287] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.547s user 0.006s sys 0.007s
W20260812 19:27:04.580547 8486 consensus_meta.cc:287] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.506s user 0.006s sys 0.006s
W20260812 19:27:04.581744 8485 consensus_meta.cc:287] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent flushing consensus metadata: real 0.607s user 0.011s sys 0.000s
I20260812 19:27:04.586225 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:04.588478 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa599b75d9e4f10b2cbed69b9b9c92b" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:04.591298 8107 leader_election.cc:341] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.591463 8514 raft_consensus.cc:3037] T 29436abddcab4a46adb5aa0c54f45389 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:04.592923 9310 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:04.594766 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:04.599622 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:04.599913 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:04.601318 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet b00a037a2567470497e1a751754df345 (table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067]). Expected version 2 got 1
I20260812 19:27:04.605769 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:04.616232 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:04.616196 8481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69ca59e00b52437a8d7ef06ebc194af3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.617024 7962 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:04.617486 9037 ts_tablet_manager.cc:1905] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:04.618603 8107 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.619472 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:04.620806 8484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6da136cadb824d18886132c8f26ccb22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.622936 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94407c13a91c4a76bd3aa1c1c8032384. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.627538 8479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a91c4d5adb3d4f97939e38e9cee79532. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:04.631845 8627 tablet_bootstrap.cc:492] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:04.632390 8627 ts_tablet_manager.cc:1397] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 1.272s user 0.012s sys 0.009s
I20260812 19:27:04.639072 8323 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44394 (request call id 188) took 1355 ms. Trace:
I20260812 19:27:04.639523 8323 rpcz_store.cc:276] 0812 19:27:03.283598 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.414192 (+130594us) service_pool.cc:227] Handling call
0812 19:27:03.415995 (+ 1803us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:03.416118 (+ 123us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:04.547817 (+1131699us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.638548 (+ 90731us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:04.639010 (+ 462us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:04.640611 8488 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:44966 (request call id 179) took 1047 ms. Trace:
I20260812 19:27:04.640961 8488 rpcz_store.cc:276] 0812 19:27:03.593011 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.708991 (+115980us) service_pool.cc:227] Handling call
0812 19:27:03.710448 (+ 1457us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:03.710541 (+ 93us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:04.038720 (+328179us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.563481 (+524761us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:04.640434 (+ 76953us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:04.642652 8636 tablet_bootstrap.cc:492] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:04.653970 7956 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
W20260812 19:27:04.659308 8108 leader_election.cc:341] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.660771 8108 leader_election.cc:302] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:04.661124 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 170) took 3022 ms. Trace:
I20260812 19:27:04.661455 9233 rpcz_store.cc:276] 0812 19:27:01.638282 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.646070 (+ 7788us) service_pool.cc:227] Handling call
0812 19:27:03.423579 (+1777509us) ts_tablet_manager.cc:1145] Deleting tablet 017b6bfef5f44da0866917e04e2db072
0812 19:27:03.423627 (+ 48us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:03.943224 (+519597us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.515148 (+571924us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.661053 (+145905us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15201,"tablet-delete.queue_time_us":1742417}
I20260812 19:27:04.655973 7956 catalog_manager.cc:5495] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:04.663072 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 017b6bfef5f44da0866917e04e2db072 (table default.Table_61a5cdb267bc48488c3252251f1e139a [id=88cdc52eec7c44d992f08f4c170a5489]) successfully deleted
I20260812 19:27:04.663250 7956 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:04.663455 9310 raft_consensus.cc:2726] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:04.664741 9233 tablet_replica.cc:330] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:04.665056 7956 catalog_manager.cc:5495] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:04.666039 7956 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:04.673103 9233 raft_consensus.cc:2229] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:04.680070 7960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 14e40943867249c58fee943fc8ed3fb0
I20260812 19:27:04.687120 9310 raft_consensus.cc:482] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:04.688180 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet 14e40943867249c58fee943fc8ed3fb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:04 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:04.687723 9310 raft_consensus.cc:504] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.690266 9310 leader_election.cc:288] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:04.690789 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:04.693102 8107 leader_election.cc:341] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.690956 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 14e40943867249c58fee943fc8ed3fb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:04 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:04.703135 7953 catalog_manager.cc:5777] Not sending DeleteTablet requests; no consensus state for tablet b1b85c19effd4cf78e9ae8c42c8dfe4b
I20260812 19:27:04.711951 9233 raft_consensus.cc:2258] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:04.714335 9233 ts_tablet_manager.cc:1905] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:04.657217 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:04.685343 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 14e40943867249c58fee943fc8ed3fb0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:04 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:04.634780 8627 raft_consensus.cc:348] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.716789 8627 raft_consensus.cc:374] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:04.717108 8627 raft_consensus.cc:729] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:04.718336 8627 consensus_queue.cc:260] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.719250 9171 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:04.719672 9171 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.722198 9171 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:04.723910 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:04.724561 8178 raft_consensus.cc:2454] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:04.724980 8623 tablet_bootstrap.cc:492] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:04.725400 8623 ts_tablet_manager.cc:1397] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.327s user 0.035s sys 0.026s
I20260812 19:27:04.726696 8281 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:04.727792 9171 raft_consensus.cc:2781] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:04.727632 8623 raft_consensus.cc:348] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.728312 8623 raft_consensus.cc:374] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:04.728200 9171 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:04.728571 8623 raft_consensus.cc:729] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:04.728796 9171 raft_consensus.cc:3037] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:04.730268 7955 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_d9b34a0091e34fc8b1cb5927605244c5" } new_table_name: "default.Table_c2e56d6bab7a4ae9aeb5725ac10e4c50" modify_external_catalogs: true
I20260812 19:27:04.730130 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_f4fba6ed708046e48420257d6693f0c3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:04.731597 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f4fba6ed708046e48420257d6693f0c3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:04.734951 8636 tablet_bootstrap.cc:654] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:04.729171 8623 consensus_queue.cc:260] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.737653 8623 ts_tablet_manager.cc:1428] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20260812 19:27:04.738528 8623 tablet_bootstrap.cc:492] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:04.759578 8623 tablet_bootstrap.cc:654] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:04.772303 8623 tablet_bootstrap.cc:492] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:04.772796 8623 ts_tablet_manager.cc:1397] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.004s
I20260812 19:27:04.774960 8623 raft_consensus.cc:348] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.775663 8623 raft_consensus.cc:374] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:04.775913 8623 raft_consensus.cc:729] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:04.776594 8623 consensus_queue.cc:260] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.778602 8623 ts_tablet_manager.cc:1428] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 19:27:04.787940 9248 consensus_queue.cc:1035] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:04.788991 8623 tablet_bootstrap.cc:492] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:04.806512 8636 tablet_bootstrap.cc:492] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:04.806941 8636 ts_tablet_manager.cc:1397] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.164s user 0.011s sys 0.003s
I20260812 19:27:04.812646 9310 consensus_queue.cc:1035] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:04.815421 8108 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.815831 8108 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:04.816931 9310 raft_consensus.cc:2726] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:04.838153 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_4b45622c6d97488f977a6ef6b04ac74e"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:04.839779 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4b45622c6d97488f977a6ef6b04ac74e in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:04.840128 9342 ts_tablet_manager.cc:1905] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:04.841878 8108 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:04.842274 8108 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:04.842478 8278 consensus_peers.cc:487] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:04.844870 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:04.845410 9307 raft_consensus.cc:2726] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:04.852730 8636 raft_consensus.cc:348] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.855692 8623 tablet_bootstrap.cc:654] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:04.863969 8636 raft_consensus.cc:374] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:04.864466 8636 raft_consensus.cc:729] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:04.866976 8636 consensus_queue.cc:260] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.873135 8636 ts_tablet_manager.cc:1428] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.066s user 0.000s sys 0.007s
I20260812 19:27:04.878360 8636 tablet_bootstrap.cc:492] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:04.891677 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_903471d080324d5480b38b2b6c7aa97a" } modify_external_catalogs: true
I20260812 19:27:04.892273 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_903471d080324d5480b38b2b6c7aa97a" } modify_external_catalogs: true
I20260812 19:27:04.754464 9171 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:04.916512 8627 ts_tablet_manager.cc:1428] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.284s user 0.006s sys 0.002s
I20260812 19:27:04.916925 7959 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:04.917624 8627 tablet_bootstrap.cc:492] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:04.932801 9037 ts_tablet_manager.cc:1918] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:04.933221 9037 log.cc:1196] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/dbafc01c482b493a981aed31ce112885
I20260812 19:27:04.933437 9171 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:04.933954 9037 ts_tablet_manager.cc:1939] T dbafc01c482b493a981aed31ce112885 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:04.936141 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:04.936769 8179 raft_consensus.cc:3037] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:04.955428 8179 raft_consensus.cc:2454] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:04.959877 9248 consensus_queue.cc:1035] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:04.935985 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 178) took 3373 ms. Trace:
I20260812 19:27:04.968699 9037 rpcz_store.cc:276] 0812 19:27:01.562879 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.563552 (+ 673us) service_pool.cc:227] Handling call
0812 19:27:04.538739 (+2975187us) ts_tablet_manager.cc:1145] Deleting tablet dbafc01c482b493a981aed31ce112885
0812 19:27:04.554195 (+ 15456us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:04.861925 (+307730us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.932572 (+ 70647us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.935932 (+ 3360us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2974457}
I20260812 19:27:04.972797 9037 tablet_replica.cc:330] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:04.972956 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet dbafc01c482b493a981aed31ce112885 (table default.Table_becd7e0ffc7a45f28e5cdf225a55abbb [id=9c67f412032b44b583e41a660ed0329e]) successfully deleted
W20260812 19:27:04.976459 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 133467us
I20260812 19:27:04.978155 9233 ts_tablet_manager.cc:1918] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:04.978602 9233 log.cc:1196] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/6f7cfdcedbaf4db7b510dd8e9f5ae867
I20260812 19:27:04.979322 9233 ts_tablet_manager.cc:1939] T 6f7cfdcedbaf4db7b510dd8e9f5ae867 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:04.980945 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:04.982718 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 173) took 3122 ms. Trace:
I20260812 19:27:04.983026 9233 rpcz_store.cc:276] 0812 19:27:01.860538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.860774 (+ 236us) service_pool.cc:227] Handling call
0812 19:27:04.664563 (+2803789us) ts_tablet_manager.cc:1145] Deleting tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867
0812 19:27:04.664621 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:04.831797 (+167176us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.977854 (+146057us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:04.982653 (+ 4799us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2802678}
I20260812 19:27:04.984203 9233 tablet_replica.cc:330] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:04.985155 9233 raft_consensus.cc:2229] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:04.985620 9233 pending_rounds.cc:62] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Trying to abort 1 pending ops.
I20260812 19:27:04.985885 9233 pending_rounds.cc:68] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761300826669056 op_type: NO_OP noop_request { }
I20260812 19:27:04.986590 9233 raft_consensus.cc:2866] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:04.987159 9037 raft_consensus.cc:2229] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:04.988476 9233 raft_consensus.cc:2258] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:04.989173 9037 pending_rounds.cc:62] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Trying to abort 1 pending ops.
I20260812 19:27:04.994230 9037 pending_rounds.cc:68] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761323494244352 op_type: NO_OP noop_request { }
I20260812 19:27:04.995491 9037 raft_consensus.cc:2866] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:04.997660 9037 raft_consensus.cc:2258] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:05.004839 9037 ts_tablet_manager.cc:1905] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:05.006798 8278 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.019630 8849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:27:05.024065 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 6f7cfdcedbaf4db7b510dd8e9f5ae867 (table default.Table_736993619204407d83bd0619aee8a645 [id=589f397fce314ea1ad0c0e42e4943267]) successfully deleted
I20260812 19:27:05.025668 8849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
W20260812 19:27:05.026777 8278 consensus_peers.cc:487] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:05.027752 8849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:05.029249 9233 ts_tablet_manager.cc:1905] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:05.033215 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:04.991088 8623 tablet_bootstrap.cc:492] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.044875 8623 ts_tablet_manager.cc:1397] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.256s user 0.026s sys 0.031s
I20260812 19:27:05.045855 8281 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:05.047806 9364 raft_consensus.cc:2781] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:05.048379 9364 raft_consensus.cc:686] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:05.049492 9364 consensus_queue.cc:237] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:05.006839 8108 leader_election.cc:341] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.010404 9342 ts_tablet_manager.cc:1918] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:05.055763 8108 leader_election.cc:302] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.055858 9342 log.cc:1196] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/1bd34ec17d8c4609ad979fab951c8a96
W20260812 19:27:05.056738 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 49945.4us
I20260812 19:27:05.056986 9342 ts_tablet_manager.cc:1939] T 1bd34ec17d8c4609ad979fab951c8a96 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:05.058771 9310 raft_consensus.cc:2726] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:05.059960 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 1bd34ec17d8c4609ad979fab951c8a96 (table default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]) successfully deleted
I20260812 19:27:05.060963 9342 tablet_replica.cc:330] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:05.061895 9342 raft_consensus.cc:2229] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:05.062933 9342 raft_consensus.cc:2258] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:05.063009 8623 raft_consensus.cc:348] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.063853 8623 raft_consensus.cc:374] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.064106 8623 raft_consensus.cc:729] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.065315 8623 consensus_queue.cc:260] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.068688 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:05.070297 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:05.071296 8623 ts_tablet_manager.cc:1428] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.026s user 0.005s sys 0.001s
I20260812 19:27:05.072590 8627 tablet_bootstrap.cc:654] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.075039 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_de249985997d434cb02a9b69b4ac8f23"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:05.077085 8623 tablet_bootstrap.cc:492] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:05.079124 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_de249985997d434cb02a9b69b4ac8f23 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:05.065338 9342 ts_tablet_manager.cc:1905] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:05.091451 8636 tablet_bootstrap.cc:654] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.093586 9037 ts_tablet_manager.cc:1918] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
W20260812 19:27:05.095937 8278 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.098376 9037 log.cc:1196] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/1bd34ec17d8c4609ad979fab951c8a96
I20260812 19:27:05.100207 9037 ts_tablet_manager.cc:1939] T 1bd34ec17d8c4609ad979fab951c8a96 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:05.112113 8627 tablet_bootstrap.cc:492] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:05.112598 8627 ts_tablet_manager.cc:1397] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.195s user 0.015s sys 0.003s
I20260812 19:27:05.115430 8627 raft_consensus.cc:348] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.116065 8627 raft_consensus.cc:374] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.120396 8627 raft_consensus.cc:729] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.097563 8623 tablet_bootstrap.cc:654] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.121553 8627 consensus_queue.cc:260] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.122399 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 4f7febfc2dcc4ec7a164485dbd6cac8b
I20260812 19:27:05.123864 8627 ts_tablet_manager.cc:1428] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20260812 19:27:05.129870 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:04 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:05.134303 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:04 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:05.135332 7958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2e98d7b67f484dab9c439b8a37451d4d" } modify_external_catalogs: true
I20260812 19:27:05.135993 7958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_2e98d7b67f484dab9c439b8a37451d4d" } modify_external_catalogs: true
I20260812 19:27:05.145095 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:04 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:27:05.148567 8107 consensus_peers.cc:487] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:05.160876 8623 tablet_bootstrap.cc:492] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.161314 8623 ts_tablet_manager.cc:1397] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.089s user 0.004s sys 0.009s
I20260812 19:27:05.164850 8623 raft_consensus.cc:348] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.170322 8623 raft_consensus.cc:374] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.171098 8623 raft_consensus.cc:729] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.171875 8623 consensus_queue.cc:260] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.179836 9342 ts_tablet_manager.cc:1918] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:27:05.182305 8627 tablet_bootstrap.cc:492] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:05.187520 8636 tablet_bootstrap.cc:492] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:05.188035 8636 ts_tablet_manager.cc:1397] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.310s user 0.012s sys 0.001s
I20260812 19:27:05.198698 8636 raft_consensus.cc:348] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.201349 8627 tablet_bootstrap.cc:654] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.193311 8623 ts_tablet_manager.cc:1428] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.032s user 0.004s sys 0.002s
I20260812 19:27:05.183039 9375 raft_consensus.cc:482] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.216939 9375 raft_consensus.cc:504] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.217612 8636 raft_consensus.cc:374] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.217962 8636 raft_consensus.cc:729] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.218997 8636 consensus_queue.cc:260] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.220461 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "544d3d74baa6477da11abbee139ee66f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:05.222693 9375 leader_election.cc:288] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:05.215742 9342 log.cc:1196] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/133d0846cf1244cf91775af0b1ae9118
W20260812 19:27:05.223577 8107 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.224278 9342 ts_tablet_manager.cc:1939] T 133d0846cf1244cf91775af0b1ae9118 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:05.226483 8636 ts_tablet_manager.cc:1428] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.038s user 0.005s sys 0.001s
I20260812 19:27:05.228314 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]) successfully deleted
I20260812 19:27:05.229907 8623 tablet_bootstrap.cc:492] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:05.245545 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 14e40943867249c58fee943fc8ed3fb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14e40943867249c58fee943fc8ed3fb0 already in progress: creating tablet
W20260812 19:27:05.247660 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f7febfc2dcc4ec7a164485dbd6cac8b already in progress: creating tablet
I20260812 19:27:05.250778 8623 tablet_bootstrap.cc:654] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.251587 9233 ts_tablet_manager.cc:1918] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:05.266633 8627 tablet_bootstrap.cc:492] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:05.267140 8627 ts_tablet_manager.cc:1397] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.085s user 0.015s sys 0.012s
I20260812 19:27:05.272094 8623 tablet_bootstrap.cc:492] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.249125 9366 raft_consensus.cc:482] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.272553 8623 ts_tablet_manager.cc:1397] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.043s user 0.004s sys 0.013s
I20260812 19:27:05.272987 9233 log.cc:1196] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/eec275b2131d4848ae120d8a841a1cae
I20260812 19:27:05.272526 9366 raft_consensus.cc:504] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.273862 9233 ts_tablet_manager.cc:1939] T eec275b2131d4848ae120d8a841a1cae P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:05.275597 9366 leader_election.cc:288] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:05.258284 8636 tablet_bootstrap.cc:492] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:05.263571 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "544d3d74baa6477da11abbee139ee66f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:05.276371 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863e7ca808f54a989b3372aa4bfe361e" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:05.276782 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863e7ca808f54a989b3372aa4bfe361e" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:05.277529 8178 raft_consensus.cc:2454] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
W20260812 19:27:05.277956 8108 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:05.278053 8278 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.278338 8108 leader_election.cc:302] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.279310 9255 raft_consensus.cc:2726] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:05.279961 8281 leader_election.cc:302] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:05.281055 9171 raft_consensus.cc:2781] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:05.281401 9171 raft_consensus.cc:482] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:05.281073 8623 raft_consensus.cc:348] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.281711 9171 raft_consensus.cc:3037] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:05.281898 8623 raft_consensus.cc:374] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.282609 8623 raft_consensus.cc:729] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.285291 8623 consensus_queue.cc:260] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.287732 8636 tablet_bootstrap.cc:654] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.290289 8627 raft_consensus.cc:348] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.291085 8627 raft_consensus.cc:374] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.291373 8627 raft_consensus.cc:729] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.292078 8627 consensus_queue.cc:260] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.292658 8623 ts_tablet_manager.cc:1428] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20260812 19:27:05.294584 8623 tablet_bootstrap.cc:492] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:05.300734 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 179) took 3737 ms. Trace:
I20260812 19:27:05.301177 9037 rpcz_store.cc:276] 0812 19:27:01.563554 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.564032 (+ 478us) service_pool.cc:227] Handling call
0812 19:27:04.972599 (+3408567us) ts_tablet_manager.cc:1145] Deleting tablet 1bd34ec17d8c4609ad979fab951c8a96
0812 19:27:04.972659 (+ 60us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.047765 (+ 75106us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.093343 (+ 45578us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.300652 (+207309us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3407899}
I20260812 19:27:05.302613 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 1bd34ec17d8c4609ad979fab951c8a96 (table default.Table_d9b34a0091e34fc8b1cb5927605244c5 [id=525ff469b92d436fba5e9319b7ddb9fc]) successfully deleted
I20260812 19:27:05.305604 8627 ts_tablet_manager.cc:1428] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20260812 19:27:05.311808 8623 tablet_bootstrap.cc:654] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.313359 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 177) took 3444 ms. Trace:
I20260812 19:27:05.313788 9233 rpcz_store.cc:276] 0812 19:27:01.869116 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.869247 (+ 131us) service_pool.cc:227] Handling call
0812 19:27:04.984007 (+3114760us) ts_tablet_manager.cc:1145] Deleting tablet eec275b2131d4848ae120d8a841a1cae
0812 19:27:04.984070 (+ 63us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.183553 (+199483us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.251316 (+ 67763us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.313283 (+ 61967us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3114183}
I20260812 19:27:05.315275 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet eec275b2131d4848ae120d8a841a1cae (table default.Table_77f5368431cf473daab21a349c850ca8 [id=e680e4a33c234a20be57640b6f7c4e61]) successfully deleted
I20260812 19:27:05.319437 9307 consensus_queue.cc:1035] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:05.308009 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 180) took 3740 ms. Trace:
I20260812 19:27:05.323086 9037 rpcz_store.cc:276] 0812 19:27:01.567674 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.567896 (+ 222us) service_pool.cc:227] Handling call
0812 19:27:05.303406 (+3735510us) ts_tablet_manager.cc:1145] Deleting tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4
0812 19:27:05.307656 (+ 4250us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.307936 (+ 280us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3734967}
I20260812 19:27:05.323936 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 178) took 3307 ms. Trace:
W20260812 19:27:05.324394 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 because the tablet was not found. No further retry: Not found: Tablet not found: 453a403d1c0b4b5c8dcd9b93c7cc9ea4
I20260812 19:27:05.325481 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 176) took 3778 ms. Trace:
I20260812 19:27:05.325789 9037 rpcz_store.cc:276] 0812 19:27:01.547136 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.628389 (+ 81253us) service_pool.cc:227] Handling call
0812 19:27:05.325148 (+3696759us) ts_tablet_manager.cc:1145] Deleting tablet 4dc5602ff1c24b6ab561389031d89885
0812 19:27:05.325210 (+ 62us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.325421 (+ 211us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3672142}
I20260812 19:27:05.324419 9233 rpcz_store.cc:276] 0812 19:27:02.016025 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:02.016185 (+ 160us) service_pool.cc:227] Handling call
0812 19:27:05.323431 (+3307246us) ts_tablet_manager.cc:1145] Deleting tablet 7e087bad986b423098a68fa5d05ff17a
0812 19:27:05.323491 (+ 60us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.323869 (+ 378us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2954475}
W20260812 19:27:05.327073 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 4dc5602ff1c24b6ab561389031d89885 because the tablet was not found. No further retry: Not found: Tablet not found: 4dc5602ff1c24b6ab561389031d89885
W20260812 19:27:05.327374 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 7e087bad986b423098a68fa5d05ff17a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e087bad986b423098a68fa5d05ff17a already in progress: creating tablet
I20260812 19:27:05.327992 9037 tablet_replica.cc:330] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:05.328715 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 188) took 1180 ms. Trace:
I20260812 19:27:05.329066 9233 rpcz_store.cc:276] 0812 19:27:04.148321 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.148517 (+ 196us) service_pool.cc:227] Handling call
0812 19:27:05.328206 (+1179689us) ts_tablet_manager.cc:1145] Deleting tablet 6da136cadb824d18886132c8f26ccb22
0812 19:27:05.328290 (+ 84us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.328594 (+ 304us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1179027}
I20260812 19:27:05.329473 9171 raft_consensus.cc:504] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:05.330502 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 6da136cadb824d18886132c8f26ccb22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6da136cadb824d18886132c8f26ccb22 already in progress: creating tablet
I20260812 19:27:05.332739 9255 raft_consensus.cc:482] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.333194 9255 raft_consensus.cc:504] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.333729 7953 master_service.cc:946] ReplaceTablet: received request to replace tablet df369d3c4e004c29ac65c5ecf7f8c4cc from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:05.334527 8627 tablet_bootstrap.cc:492] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:05.336722 8242 heartbeater.cc:347] Connected to a master server at 127.7.144.252:46815
I20260812 19:27:05.339583 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863e7ca808f54a989b3372aa4bfe361e" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:05.343478 9255 leader_election.cc:288] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:05.344343 7960 master_service.cc:946] ReplaceTablet: received request to replace tablet 69ca59e00b52437a8d7ef06ebc194af3 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:05.344779 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df369d3c4e004c29ac65c5ecf7f8c4cc" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:05.346052 8107 leader_election.cc:341] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.332739 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863e7ca808f54a989b3372aa4bfe361e" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:05.348722 9282 raft_consensus.cc:482] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.349004 8178 raft_consensus.cc:3037] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:05.349157 9282 raft_consensus.cc:504] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.351130 9282 leader_election.cc:288] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:05.351344 8278 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.353153 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df369d3c4e004c29ac65c5ecf7f8c4cc" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:05.358067 8446 leader_election.cc:341] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: dbafc01c482b493a981aed31ce112885
I20260812 19:27:05.359484 8178 raft_consensus.cc:2454] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:05.360368 9171 leader_election.cc:288] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:05.360554 8108 leader_election.cc:341] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.361094 8108 leader_election.cc:302] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.362298 9255 raft_consensus.cc:2726] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:05.362763 9037 raft_consensus.cc:2229] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:27:05.370795 8443 leader_election.cc:341] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: dbafc01c482b493a981aed31ce112885
I20260812 19:27:05.371220 8443 leader_election.cc:302] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.372352 9282 raft_consensus.cc:2726] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:05.379846 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 968eb13e27ea4f93a45aad17110b0ee4 consensus state has no leader
I20260812 19:27:05.399827 9037 raft_consensus.cc:2258] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:05.402319 8636 tablet_bootstrap.cc:492] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:05.402765 8636 ts_tablet_manager.cc:1397] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.145s user 0.009s sys 0.003s
I20260812 19:27:05.406899 8627 tablet_bootstrap.cc:654] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:05.411471 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet f57f252b520945328fdaaa9adef593a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f57f252b520945328fdaaa9adef593a1 already in progress: creating tablet
I20260812 19:27:05.412142 7958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet b73ea5acf663420cbe9236c014d71199
I20260812 19:27:05.413883 8281 leader_election.cc:302] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:05.420344 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet b73ea5acf663420cbe9236c014d71199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:05 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:05.420586 9171 raft_consensus.cc:2781] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:05.422137 9233 tablet_replica.cc:330] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:05.423753 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet b73ea5acf663420cbe9236c014d71199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:05 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:05.421221 9171 raft_consensus.cc:686] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:05.425149 9171 consensus_queue.cc:237] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:05.426697 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet b73ea5acf663420cbe9236c014d71199 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b73ea5acf663420cbe9236c014d71199 already in progress: creating tablet
I20260812 19:27:05.430399 9037 ts_tablet_manager.cc:1905] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:05.430418 7953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet df369d3c4e004c29ac65c5ecf7f8c4cc
I20260812 19:27:05.435787 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet b73ea5acf663420cbe9236c014d71199 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:05 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:05.438750 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc with delete_type TABLET_DATA_DELETED (replaced by tablet c607886a76344185aa9af5da797b9ae8) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:05.442346 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc with delete_type TABLET_DATA_DELETED (replaced by tablet c607886a76344185aa9af5da797b9ae8) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:05.442574 7953 catalog_manager.cc:6565] ReplaceTablet: tablet df369d3c4e004c29ac65c5ecf7f8c4cc deleted and replaced by tablet c607886a76344185aa9af5da797b9ae8
I20260812 19:27:05.442637 9233 raft_consensus.cc:2229] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:05.443224 9342 tablet_replica.cc:330] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:05.443256 9233 raft_consensus.cc:2258] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:05.443976 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_cf8b0698da1e4cdb8c505f5337faa983"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:05.444468 9342 raft_consensus.cc:2229] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:05.445043 9342 raft_consensus.cc:2258] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:05.445629 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_cf8b0698da1e4cdb8c505f5337faa983 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:05.447669 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc with delete_type TABLET_DATA_DELETED (replaced by tablet c607886a76344185aa9af5da797b9ae8) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:05.449900 9342 ts_tablet_manager.cc:1905] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:05.450145 8623 tablet_bootstrap.cc:492] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.450685 8623 ts_tablet_manager.cc:1397] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.156s user 0.007s sys 0.017s
I20260812 19:27:05.453904 8623 raft_consensus.cc:348] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:05.454738 8623 raft_consensus.cc:374] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.455041 8623 raft_consensus.cc:729] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.455865 8623 consensus_queue.cc:260] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:05.468782 8623 ts_tablet_manager.cc:1428] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.018s user 0.010s sys 0.000s
I20260812 19:27:05.471410 8623 tablet_bootstrap.cc:492] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:05.482687 9233 ts_tablet_manager.cc:1905] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:05.511696 8627 tablet_bootstrap.cc:492] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:05.511729 8623 tablet_bootstrap.cc:654] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.512287 8627 ts_tablet_manager.cc:1397] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.178s user 0.012s sys 0.006s
I20260812 19:27:05.514588 8627 raft_consensus.cc:348] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.515333 8627 raft_consensus.cc:374] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.515647 8627 raft_consensus.cc:729] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.517670 8636 raft_consensus.cc:348] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.518404 8636 raft_consensus.cc:374] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.518682 8636 raft_consensus.cc:729] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.519375 8636 consensus_queue.cc:260] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.521924 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_bbda5db214af4795b1d794c0bfa3b278"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:05.523623 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bbda5db214af4795b1d794c0bfa3b278 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:05.544608 8627 consensus_queue.cc:260] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.549474 8623 tablet_bootstrap.cc:492] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.549904 8623 ts_tablet_manager.cc:1397] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.079s user 0.006s sys 0.004s
I20260812 19:27:05.550788 9307 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.551819 8627 ts_tablet_manager.cc:1428] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.039s user 0.006s sys 0.000s
I20260812 19:27:05.551363 9307 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.552834 8627 tablet_bootstrap.cc:492] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:05.560436 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:05.562225 8108 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.562927 9307 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:05.565647 9037 ts_tablet_manager.cc:1918] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:05.567232 8623 raft_consensus.cc:348] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.569521 8623 raft_consensus.cc:374] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.570452 8623 raft_consensus.cc:729] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.572177 9037 log.cc:1196] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:05.573292 8623 consensus_queue.cc:260] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.575801 9037 ts_tablet_manager.cc:1939] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:05.555294 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:05.582279 8623 ts_tablet_manager.cc:1428] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.032s user 0.010s sys 0.000s
I20260812 19:27:05.584995 8636 ts_tablet_manager.cc:1428] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.182s user 0.006s sys 0.002s
I20260812 19:27:05.585497 8623 tablet_bootstrap.cc:492] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:05.583060 8107 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.590255 8107 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.593328 9255 raft_consensus.cc:2726] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:05.594161 8510 raft_consensus.cc:3037] T eaaf04a85946447aa43873e3568aa3a3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:05.640910 9233 ts_tablet_manager.cc:1918] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:05.643540 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 185) took 3838 ms. Trace:
I20260812 19:27:05.644817 9037 rpcz_store.cc:276] 0812 19:27:01.805012 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.805154 (+ 142us) service_pool.cc:227] Handling call
0812 19:27:05.327826 (+3522672us) ts_tablet_manager.cc:1145] Deleting tablet bc5c4ef0441c49fca31b2fc8a2c9abd4
0812 19:27:05.327877 (+ 51us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.504447 (+176570us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.565408 (+ 60961us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.643473 (+ 78065us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3520616}
I20260812 19:27:05.647774 9037 tablet_replica.cc:330] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:05.648978 9037 raft_consensus.cc:2229] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:05.657217 9037 raft_consensus.cc:2258] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:05.659807 9037 ts_tablet_manager.cc:1905] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:05.660593 9307 raft_consensus.cc:482] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.662088 9233 log.cc:1196] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/453a403d1c0b4b5c8dcd9b93c7cc9ea4
I20260812 19:27:05.663208 9233 ts_tablet_manager.cc:1939] T 453a403d1c0b4b5c8dcd9b93c7cc9ea4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:05.659828 8636 tablet_bootstrap.cc:492] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:05.661231 9307 raft_consensus.cc:504] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.681237 8623 tablet_bootstrap.cc:654] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.681903 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:05.688541 8107 leader_election.cc:341] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.692734 8627 tablet_bootstrap.cc:654] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.693136 9037 ts_tablet_manager.cc:1918] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:05.679580 9310 raft_consensus.cc:482] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.679316 9307 leader_election.cc:288] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:05.702109 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 190) took 1292 ms. Trace:
I20260812 19:27:05.702332 9310 raft_consensus.cc:504] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:05.704607 9310 leader_election.cc:288] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:05.702643 9233 rpcz_store.cc:276] 0812 19:27:04.409661 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.413555 (+ 3894us) service_pool.cc:227] Handling call
0812 19:27:05.421895 (+1008340us) ts_tablet_manager.cc:1145] Deleting tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4
0812 19:27:05.421959 (+ 64us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.514772 (+ 92813us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.640539 (+125767us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.702025 (+ 61486us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35318,"tablet-delete.queue_time_us":1007702}
I20260812 19:27:05.715963 9307 raft_consensus.cc:482] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.716627 9307 raft_consensus.cc:504] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.720314 9307 leader_election.cc:288] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:05.734128 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 (table default.Table_e13f5860d61746f4b3d9ecda0df98a09 [id=dbcf165b445f4ef8a27f2d58ac93b3d2]) successfully deleted
I20260812 19:27:05.734632 8636 tablet_bootstrap.cc:654] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:05.753132 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 63430.8us
I20260812 19:27:05.755657 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6075b2e46524829962d2b84353013b2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:05.756956 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:05.709589 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:05.713140 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6075b2e46524829962d2b84353013b2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:05.763029 9037 log.cc:1196] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/22fe32c0d82845b8a9f0c0e4d88f7d39
I20260812 19:27:05.721905 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:05.763868 9037 ts_tablet_manager.cc:1939] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:05.766333 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 186) took 3959 ms. Trace:
I20260812 19:27:05.772629 9282 raft_consensus.cc:482] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.773315 9282 raft_consensus.cc:504] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.775242 9282 leader_election.cc:288] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:05.762104 8107 leader_election.cc:341] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:05.778774 8107 leader_election.cc:341] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:05.780210 8443 leader_election.cc:341] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: da5f9e7431654d5fbae5d554c6f14569
W20260812 19:27:05.765722 8108 leader_election.cc:341] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.782033 8108 leader_election.cc:302] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:05.783330 8108 leader_election.cc:341] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.784422 8108 leader_election.cc:302] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.783874 9416 raft_consensus.cc:2726] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:05.787849 8623 tablet_bootstrap.cc:492] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.788376 8623 ts_tablet_manager.cc:1397] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.203s user 0.010s sys 0.007s
I20260812 19:27:05.788373 9255 raft_consensus.cc:2726] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:05.789929 8108 leader_election.cc:341] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.785567 9037 rpcz_store.cc:276] 0812 19:27:01.806917 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.807281 (+ 364us) service_pool.cc:227] Handling call
0812 19:27:05.647545 (+3840264us) ts_tablet_manager.cc:1145] Deleting tablet 22fe32c0d82845b8a9f0c0e4d88f7d39
0812 19:27:05.647626 (+ 81us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.677856 (+ 30230us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.692832 (+ 14976us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.766279 (+ 73447us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3839627}
I20260812 19:27:05.790447 8108 leader_election.cc:302] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.793511 9415 raft_consensus.cc:2726] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:05.795131 8623 raft_consensus.cc:348] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:05.796957 8446 leader_election.cc:341] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: da5f9e7431654d5fbae5d554c6f14569
I20260812 19:27:05.797495 8446 leader_election.cc:302] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:05.797734 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 187) took 3803 ms. Trace:
I20260812 19:27:05.798532 8623 raft_consensus.cc:374] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.798761 8623 raft_consensus.cc:729] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.799209 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 (table default.Table_3e9699a08d4b49aa9f6e7b830481562a [id=9d326d6a71a4424494c26dc6095b1649]) successfully deleted
I20260812 19:27:05.798034 9037 rpcz_store.cc:276] 0812 19:27:01.994976 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:01.995303 (+ 327us) service_pool.cc:227] Handling call
0812 19:27:05.797118 (+3801815us) ts_tablet_manager.cc:1145] Deleting tablet 7e087bad986b423098a68fa5d05ff17a
0812 19:27:05.797341 (+ 223us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.797674 (+ 333us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":3800876}
I20260812 19:27:05.800060 9282 raft_consensus.cc:2726] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:05.801851 9342 ts_tablet_manager.cc:1918] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:05.803489 7960 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 69ca59e00b52437a8d7ef06ebc194af3
W20260812 19:27:05.805022 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 7e087bad986b423098a68fa5d05ff17a because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 7e087bad986b423098a68fa5d05ff17a already in progress: creating tablet
I20260812 19:27:05.805173 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 196) took 2169 ms. Trace:
I20260812 19:27:05.804244 9342 log.cc:1196] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/df369d3c4e004c29ac65c5ecf7f8c4cc
I20260812 19:27:05.805543 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ca59e00b52437a8d7ef06ebc194af3 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b32b8e857c04567a2a751c379a05440) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:05.805593 9037 rpcz_store.cc:276] 0812 19:27:03.635636 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.635965 (+ 329us) service_pool.cc:227] Handling call
0812 19:27:05.804656 (+2168691us) ts_tablet_manager.cc:1145] Deleting tablet 6da136cadb824d18886132c8f26ccb22
0812 19:27:05.804721 (+ 65us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.805108 (+ 387us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2167367}
I20260812 19:27:05.806572 9342 ts_tablet_manager.cc:1939] T df369d3c4e004c29ac65c5ecf7f8c4cc P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:05.808053 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ca59e00b52437a8d7ef06ebc194af3 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b32b8e857c04567a2a751c379a05440) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:05.799304 8623 consensus_queue.cc:260] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.809459 7960 catalog_manager.cc:6565] ReplaceTablet: tablet 69ca59e00b52437a8d7ef06ebc194af3 deleted and replaced by tablet 6b32b8e857c04567a2a751c379a05440
I20260812 19:27:05.811597 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet df369d3c4e004c29ac65c5ecf7f8c4cc (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]) successfully deleted
W20260812 19:27:05.813755 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 69ca59e00b52437a8d7ef06ebc194af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ca59e00b52437a8d7ef06ebc194af3 already in progress: creating tablet
I20260812 19:27:05.814740 8623 ts_tablet_manager.cc:1428] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.026s user 0.004s sys 0.002s
I20260812 19:27:05.810386 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet 69ca59e00b52437a8d7ef06ebc194af3 with delete_type TABLET_DATA_DELETED (replaced by tablet 6b32b8e857c04567a2a751c379a05440) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:05.816071 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 197) took 2179 ms. Trace:
I20260812 19:27:05.820549 9037 rpcz_store.cc:276] 0812 19:27:03.636236 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.636515 (+ 279us) service_pool.cc:227] Handling call
0812 19:27:05.815720 (+2179205us) ts_tablet_manager.cc:1145] Deleting tablet cfbf700d55a04b529507259406bdd5a1
0812 19:27:05.815761 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.816016 (+ 255us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2155572}
I20260812 19:27:05.733314 9233 tablet_replica.cc:330] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:05.825314 8623 tablet_bootstrap.cc:492] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:05.830713 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 202) took 1360 ms. Trace:
I20260812 19:27:05.832515 9037 rpcz_store.cc:276] 0812 19:27:04.470385 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.470497 (+ 112us) service_pool.cc:227] Handling call
0812 19:27:05.829973 (+1359476us) ts_tablet_manager.cc:1145] Deleting tablet f57f252b520945328fdaaa9adef593a1
0812 19:27:05.830046 (+ 73us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.830444 (+ 398us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1357652}
I20260812 19:27:05.841404 9037 tablet_replica.cc:330] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:27:05.816227 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 6da136cadb824d18886132c8f26ccb22 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 6da136cadb824d18886132c8f26ccb22 already in progress: creating tablet
I20260812 19:27:05.845585 9037 raft_consensus.cc:2229] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 19:27:05.844695 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet f57f252b520945328fdaaa9adef593a1 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet f57f252b520945328fdaaa9adef593a1 already in progress: creating tablet
I20260812 19:27:05.847522 8623 tablet_bootstrap.cc:654] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.848624 9037 raft_consensus.cc:2258] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:05.852877 9037 ts_tablet_manager.cc:1905] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:05.848740 8627 tablet_bootstrap.cc:492] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:05.860435 8627 ts_tablet_manager.cc:1397] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.308s user 0.013s sys 0.002s
I20260812 19:27:05.821290 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:05.866822 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:05.863459 8627 raft_consensus.cc:348] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.867267 8627 raft_consensus.cc:374] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.868556 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:05.869999 7954 catalog_manager.cc:5495] T 30940fe1277e4347941f3525f6448cdb P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } }
I20260812 19:27:05.871536 8627 raft_consensus.cc:729] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.872370 8627 consensus_queue.cc:260] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.878072 8627 ts_tablet_manager.cc:1428] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20260812 19:27:05.885730 8481 tablet_service.cc:1467] Processing CreateTablet for tablet f093c8ebbcae4d33918a3c9f30eabb5a (DEFAULT_TABLE table=default.Table_1ffdf4360f8748df9e45c5b04dc093e5 [id=e2abe957f6434f35a9da50378bd4aa35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:05.887790 8481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f093c8ebbcae4d33918a3c9f30eabb5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:05.889827 8623 tablet_bootstrap.cc:492] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.890246 8623 ts_tablet_manager.cc:1397] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.003s
I20260812 19:27:05.893630 8623 raft_consensus.cc:348] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.894585 8623 raft_consensus.cc:374] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.894906 8623 raft_consensus.cc:729] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.898335 8627 tablet_bootstrap.cc:492] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:05.910140 8278 consensus_peers.cc:487] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:05.912906 8330 tablet_service.cc:1467] Processing CreateTablet for tablet f093c8ebbcae4d33918a3c9f30eabb5a (DEFAULT_TABLE table=default.Table_1ffdf4360f8748df9e45c5b04dc093e5 [id=e2abe957f6434f35a9da50378bd4aa35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:05.914062 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f093c8ebbcae4d33918a3c9f30eabb5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:05.895916 8623 consensus_queue.cc:260] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.918605 8147 tablet_service.cc:1467] Processing CreateTablet for tablet f093c8ebbcae4d33918a3c9f30eabb5a (DEFAULT_TABLE table=default.Table_1ffdf4360f8748df9e45c5b04dc093e5 [id=e2abe957f6434f35a9da50378bd4aa35]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:05.919646 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f093c8ebbcae4d33918a3c9f30eabb5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:05.919963 9233 raft_consensus.cc:2229] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:05.920604 9233 raft_consensus.cc:2258] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:05.920738 8623 ts_tablet_manager.cc:1428] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.030s user 0.010s sys 0.000s
I20260812 19:27:05.922529 9233 ts_tablet_manager.cc:1905] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:05.923511 7955 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6075b2e46524829962d2b84353013b2 consensus state has no leader
I20260812 19:27:05.924075 7955 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 244) took 1194 ms. Trace:
I20260812 19:27:05.924678 8627 tablet_bootstrap.cc:654] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.924588 7955 rpcz_store.cc:276] 0812 19:27:04.729860 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.730002 (+ 142us) service_pool.cc:227] Handling call
0812 19:27:04.730785 (+ 783us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:04.731441 (+ 656us) catalog_manager.cc:3616] Apply alter schema
0812 19:27:04.732501 (+ 1060us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:27:04.732714 (+ 213us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:27:04.919467 (+186753us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:27:05.924014 (+1004547us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:04.734375 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:04.734735 (+ 360us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:04.734757 (+ 22us) write_op.cc:435] Acquired schema lock
0812 19:27:04.734769 (+ 12us) tablet.cc:660] Decoding operations
0812 19:27:04.735012 (+ 243us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:04.735047 (+ 35us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:04.735070 (+ 23us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:04.735201 (+ 131us) tablet.cc:699] Row locks acquired
0812 19:27:04.735214 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:27:04.735320 (+ 106us) write_op.cc:270] Start()
0812 19:27:04.735475 (+ 155us) write_op.cc:276] Timestamp: P: 1786562824735242 usec, L: 0
0812 19:27:04.735490 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:27:04.735942 (+ 452us) log.cc:842] Serialized 405 byte log entry
0812 19:27:04.906969 (+171027us) op_driver.cc:444] REPLICATION: finished
0812 19:27:04.907322 (+ 353us) write_op.cc:301] APPLY: starting
0812 19:27:04.907373 (+ 51us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:04.907447 (+ 74us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:04.907530 (+ 83us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:04.907670 (+ 140us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:04.907808 (+ 138us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:04.907853 (+ 45us) write_op.cc:312] APPLY: finished
0812 19:27:04.908009 (+ 156us) log.cc:842] Serialized 23 byte log entry
0812 19:27:04.918892 (+ 10883us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:04.918953 (+ 61us) write_op.cc:454] Released schema lock
0812 19:27:04.918985 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:04.919161 (+ 176us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:04.919183 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":236,"apply.run_cpu_time_us":1343,"apply.run_wall_time_us":12004,"mutex_wait_us":10680,"num_ops":1,"prepare.queue_time_us":234,"prepare.run_cpu_time_us":1701,"prepare.run_wall_time_us":1756,"replication_time_us":171422}]]}
I20260812 19:27:05.929013 7955 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ed88cc07fe0945fd90987488667b3df3" } modify_external_catalogs: true
I20260812 19:27:05.929548 7955 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_ed88cc07fe0945fd90987488667b3df3" } modify_external_catalogs: true
I20260812 19:27:05.934753 8623 tablet_bootstrap.cc:492] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:05.946045 9037 ts_tablet_manager.cc:1918] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:27:05.946455 9037 log.cc:1196] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/133d0846cf1244cf91775af0b1ae9118
I20260812 19:27:05.947192 9037 ts_tablet_manager.cc:1939] T 133d0846cf1244cf91775af0b1ae9118 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:05.950860 8623 tablet_bootstrap.cc:654] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:05.955287 8627 tablet_bootstrap.cc:492] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:05.955683 8627 ts_tablet_manager.cc:1397] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.058s user 0.011s sys 0.000s
I20260812 19:27:05.957803 8627 raft_consensus.cc:348] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.958455 8627 raft_consensus.cc:374] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.958699 8627 raft_consensus.cc:729] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:05.959658 9171 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:05.959390 8627 consensus_queue.cc:260] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.960112 9171 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.962131 9171 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:05.963601 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:05.964231 8178 raft_consensus.cc:2454] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:05.964779 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 204) took 1386 ms. Trace:
I20260812 19:27:05.964895 7955 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet e6ef4b3497284a799d4a4f45d7609e45
I20260812 19:27:05.965195 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:05.965102 9037 rpcz_store.cc:276] 0812 19:27:04.578100 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.594546 (+ 16446us) service_pool.cc:227] Handling call
0812 19:27:05.841178 (+1246632us) ts_tablet_manager.cc:1145] Deleting tablet 133d0846cf1244cf91775af0b1ae9118
0812 19:27:05.841242 (+ 64us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.904124 (+ 62882us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.945822 (+ 41698us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:05.964705 (+ 18883us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1245898}
I20260812 19:27:05.966303 9037 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 205) took 1282 ms. Trace:
I20260812 19:27:05.966500 8484 tablet_service.cc:1514] Processing DeleteTablet for tablet e6ef4b3497284a799d4a4f45d7609e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:05 UTC) from {username='slave'} at 127.0.0.1:44966
W20260812 19:27:05.966758 8278 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.966562 9037 rpcz_store.cc:276] 0812 19:27:04.683947 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.684972 (+ 1025us) service_pool.cc:227] Handling call
0812 19:27:05.965952 (+1280980us) ts_tablet_manager.cc:1145] Deleting tablet 14e40943867249c58fee943fc8ed3fb0
0812 19:27:05.965993 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:05.966254 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1249922}
I20260812 19:27:05.967260 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]) successfully deleted
I20260812 19:27:05.968842 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet e6ef4b3497284a799d4a4f45d7609e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:05 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:05.969108 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet e6ef4b3497284a799d4a4f45d7609e45 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:05 UTC) from {username='slave'} at 127.0.0.1:44394
W20260812 19:27:05.970726 7948 catalog_manager.cc:4821] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet e6ef4b3497284a799d4a4f45d7609e45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ef4b3497284a799d4a4f45d7609e45 already in progress: creating tablet
W20260812 19:27:05.971135 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 14e40943867249c58fee943fc8ed3fb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14e40943867249c58fee943fc8ed3fb0 already in progress: creating tablet
I20260812 19:27:05.971427 8281 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:27:05.971704 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f7febfc2dcc4ec7a164485dbd6cac8b already in progress: creating tablet
W20260812 19:27:05.972215 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet b73ea5acf663420cbe9236c014d71199 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b73ea5acf663420cbe9236c014d71199 already in progress: creating tablet
I20260812 19:27:05.974951 9171 raft_consensus.cc:2781] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:05.975281 9171 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:05.975584 9171 raft_consensus.cc:3037] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:05.976016 8623 tablet_bootstrap.cc:492] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:05.976470 8623 ts_tablet_manager.cc:1397] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.042s user 0.010s sys 0.000s
I20260812 19:27:05.978531 8623 raft_consensus.cc:348] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.979144 8623 raft_consensus.cc:374] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:05.979394 8623 raft_consensus.cc:729] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
W20260812 19:27:05.982568 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet df369d3c4e004c29ac65c5ecf7f8c4cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df369d3c4e004c29ac65c5ecf7f8c4cc already in progress: creating tablet
W20260812 19:27:05.983196 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 69ca59e00b52437a8d7ef06ebc194af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ca59e00b52437a8d7ef06ebc194af3 already in progress: creating tablet
W20260812 19:27:05.983731 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet e6ef4b3497284a799d4a4f45d7609e45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ef4b3497284a799d4a4f45d7609e45 already in progress: creating tablet
I20260812 19:27:05.986271 8627 ts_tablet_manager.cc:1428] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.030s user 0.005s sys 0.002s
I20260812 19:27:05.987651 8627 tablet_bootstrap.cc:492] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:05.991884 8484 tablet_service.cc:1467] Processing CreateTablet for tablet 2175811e6a7646c3ae82daaa8c626bca (DEFAULT_TABLE table=default.Table_65e0e363703e439ea5476db643057688 [id=d7a96e113ac74e29bb7f9be4d43d7fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:05.992753 8623 consensus_queue.cc:260] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:05.994119 8484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2175811e6a7646c3ae82daaa8c626bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.002871 8623 ts_tablet_manager.cc:1428] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.026s user 0.005s sys 0.000s
I20260812 19:27:06.007896 8627 tablet_bootstrap.cc:654] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.011519 9440 raft_consensus.cc:482] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.012403 9440 raft_consensus.cc:504] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.013921 8636 tablet_bootstrap.cc:492] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:06.014431 8636 ts_tablet_manager.cc:1397] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.355s user 0.007s sys 0.007s
I20260812 19:27:06.014674 9440 leader_election.cc:288] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:06.018786 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 2175811e6a7646c3ae82daaa8c626bca (DEFAULT_TABLE table=default.Table_65e0e363703e439ea5476db643057688 [id=d7a96e113ac74e29bb7f9be4d43d7fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.019773 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2175811e6a7646c3ae82daaa8c626bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.020982 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249da5c0bd73498bbfc8f41e7513a9d4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:06.022666 8278 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.022732 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249da5c0bd73498bbfc8f41e7513a9d4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:06.023617 8178 raft_consensus.cc:2454] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:06.024896 8281 leader_election.cc:302] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:06.026585 9440 raft_consensus.cc:2781] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:06.026919 9440 raft_consensus.cc:482] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:06.027230 9440 raft_consensus.cc:3037] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.034514 8627 tablet_bootstrap.cc:492] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:06.034940 8627 ts_tablet_manager.cc:1397] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.047s user 0.011s sys 0.003s
I20260812 19:27:06.036931 8623 tablet_bootstrap.cc:492] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:06.044670 8623 tablet_bootstrap.cc:654] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.046582 8627 raft_consensus.cc:348] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.047238 8627 raft_consensus.cc:374] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.047472 8627 raft_consensus.cc:729] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.048022 8627 consensus_queue.cc:260] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.049788 9444 consensus_queue.cc:1035] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:06.070791 8623 tablet_bootstrap.cc:492] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:06.071337 8623 ts_tablet_manager.cc:1397] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.035s user 0.012s sys 0.000s
I20260812 19:27:06.074263 8623 raft_consensus.cc:348] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.089862 8623 raft_consensus.cc:374] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.090231 8623 raft_consensus.cc:729] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.091090 8623 consensus_queue.cc:260] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.110033 8623 ts_tablet_manager.cc:1428] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.038s user 0.010s sys 0.000s
I20260812 19:27:06.111326 8623 tablet_bootstrap.cc:492] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:06.116350 9255 raft_consensus.cc:482] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.116905 9255 raft_consensus.cc:504] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.120108 9255 leader_election.cc:288] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:06.123461 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:06.125720 8479 tablet_service.cc:1467] Processing CreateTablet for tablet e0451c2d5d6b4851a83ee9d30aa40a6c (DEFAULT_TABLE table=default.Table_b8f8f3637e9344998414afa9cf1f2d45 [id=bfa823ee749942f5898a16fa6a064fe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.127673 8479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0451c2d5d6b4851a83ee9d30aa40a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.128247 8492 tablet_service.cc:1467] Processing CreateTablet for tablet 613763d1b3074766bee2d026de516065 (DEFAULT_TABLE table=default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.129254 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 613763d1b3074766bee2d026de516065. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:06.145925 8107 leader_election.cc:341] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:05.987963 9171 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.183543 8623 tablet_bootstrap.cc:654] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.184798 8152 tablet_service.cc:1467] Processing CreateTablet for tablet e0451c2d5d6b4851a83ee9d30aa40a6c (DEFAULT_TABLE table=default.Table_b8f8f3637e9344998414afa9cf1f2d45 [id=bfa823ee749942f5898a16fa6a064fe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.186066 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0451c2d5d6b4851a83ee9d30aa40a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.187645 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 2175811e6a7646c3ae82daaa8c626bca (DEFAULT_TABLE table=default.Table_65e0e363703e439ea5476db643057688 [id=d7a96e113ac74e29bb7f9be4d43d7fa8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.188920 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2175811e6a7646c3ae82daaa8c626bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.189682 8330 tablet_service.cc:1467] Processing CreateTablet for tablet e0451c2d5d6b4851a83ee9d30aa40a6c (DEFAULT_TABLE table=default.Table_b8f8f3637e9344998414afa9cf1f2d45 [id=bfa823ee749942f5898a16fa6a064fe6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.189345 9255 raft_consensus.cc:482] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.191008 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0451c2d5d6b4851a83ee9d30aa40a6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.191056 9255 raft_consensus.cc:504] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.193823 9255 leader_election.cc:288] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:06.195263 7955 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_4ba940c06806406eb455a26f9e2c0917"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:06.201170 9449 raft_consensus.cc:482] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.201828 9449 raft_consensus.cc:504] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.204244 9449 leader_election.cc:288] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:06.205080 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:06.205754 8178 raft_consensus.cc:2454] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:06.205892 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:06.206913 8281 leader_election.cc:302] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:27:06.207544 8107 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.207651 9449 raft_consensus.cc:2781] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:06.210880 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:06.211640 8179 raft_consensus.cc:3037] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.213336 8636 raft_consensus.cc:348] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.214007 8636 raft_consensus.cc:374] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.214247 8636 raft_consensus.cc:729] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.220753 8179 raft_consensus.cc:2454] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:06.221626 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:06.224191 7955 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_4ba940c06806406eb455a26f9e2c0917 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:06.226542 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:06.236537 9416 raft_consensus.cc:482] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.237015 9416 raft_consensus.cc:504] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.239521 8636 consensus_queue.cc:260] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.245364 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:06.249521 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:06.250075 9416 leader_election.cc:288] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:06.250056 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:06.250384 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet f7c9e6328b70417cbeecf31f318f9b61 (table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]). Expected version 1 got 0
I20260812 19:27:06.251977 7958 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
W20260812 19:27:06.251453 8107 leader_election.cc:341] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.259624 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 613763d1b3074766bee2d026de516065 (DEFAULT_TABLE table=default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.260731 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 613763d1b3074766bee2d026de516065. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.261327 8623 tablet_bootstrap.cc:492] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:06.206753 8627 ts_tablet_manager.cc:1428] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.172s user 0.013s sys 0.017s
I20260812 19:27:06.210724 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:06.265753 8627 tablet_bootstrap.cc:492] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:06.211241 9440 raft_consensus.cc:504] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.269937 9440 leader_election.cc:288] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:06.214911 9171 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:06.221927 8281 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:06.228525 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:06.271333 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 49479us
W20260812 19:27:06.251963 8278 leader_election.cc:341] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.257625 8326 tablet_service.cc:1467] Processing CreateTablet for tablet 613763d1b3074766bee2d026de516065 (DEFAULT_TABLE table=default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:27:06.273320 8278 consensus_peers.cc:487] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:06.273633 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 613763d1b3074766bee2d026de516065. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:06.273810 8278 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.277472 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:06.278934 8108 leader_election.cc:341] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.279106 8636 ts_tablet_manager.cc:1428] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.264s user 0.001s sys 0.004s
I20260812 19:27:06.279354 8108 leader_election.cc:302] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:06.282428 9171 raft_consensus.cc:2781] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:06.283035 9171 raft_consensus.cc:686] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:06.284081 9171 consensus_queue.cc:237] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.288152 9416 raft_consensus.cc:2726] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:06.290208 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249da5c0bd73498bbfc8f41e7513a9d4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:06.290860 8179 raft_consensus.cc:3037] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.297451 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "249da5c0bd73498bbfc8f41e7513a9d4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:06.299014 8108 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.299437 8108 leader_election.cc:302] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:06.300813 9255 raft_consensus.cc:2726] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:06.303049 8108 consensus_peers.cc:487] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22fe32c0d82845b8a9f0c0e4d88f7d39. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:06.303915 8108 leader_election.cc:341] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.304468 8108 leader_election.cc:302] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:06.305191 9416 raft_consensus.cc:2726] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:06.308182 8278 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.310920 9449 raft_consensus.cc:482] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:06.311463 9449 raft_consensus.cc:3037] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.313407 9416 raft_consensus.cc:482] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.313963 9416 raft_consensus.cc:504] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.317186 8636 tablet_bootstrap.cc:492] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:06.317718 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:06.315999 9416 leader_election.cc:288] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:06.319366 8107 leader_election.cc:341] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.325403 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:06.327721 8108 leader_election.cc:341] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.328238 8108 leader_election.cc:302] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:06.329628 9416 raft_consensus.cc:2726] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:06.261679 8623 ts_tablet_manager.cc:1397] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.151s user 0.008s sys 0.004s
I20260812 19:27:06.349573 8179 raft_consensus.cc:2454] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:06.360361 9233 ts_tablet_manager.cc:1918] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3
I20260812 19:27:06.360903 9233 log.cc:1196] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/133d0846cf1244cf91775af0b1ae9118
I20260812 19:27:06.361771 9233 ts_tablet_manager.cc:1939] T 133d0846cf1244cf91775af0b1ae9118 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:06.363787 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 197) took 1792 ms. Trace:
I20260812 19:27:06.364159 9233 rpcz_store.cc:276] 0812 19:27:04.570910 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.576359 (+ 5449us) service_pool.cc:227] Handling call
0812 19:27:05.732981 (+1156622us) ts_tablet_manager.cc:1145] Deleting tablet 133d0846cf1244cf91775af0b1ae9118
0812 19:27:05.733086 (+ 105us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:06.330529 (+597443us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:06.360107 (+ 29578us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:06.363723 (+ 3616us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26427,"tablet-delete.queue_time_us":1155489}
I20260812 19:27:06.365974 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 198) took 1678 ms. Trace:
I20260812 19:27:06.366343 9233 rpcz_store.cc:276] 0812 19:27:04.687779 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.687954 (+ 175us) service_pool.cc:227] Handling call
0812 19:27:06.365629 (+1677675us) ts_tablet_manager.cc:1145] Deleting tablet 14e40943867249c58fee943fc8ed3fb0
0812 19:27:06.365670 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:06.365931 (+ 261us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1677025}
I20260812 19:27:06.367723 9233 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 199) took 1223 ms. Trace:
I20260812 19:27:06.368040 9233 rpcz_store.cc:276] 0812 19:27:05.144712 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:05.144862 (+ 150us) service_pool.cc:227] Handling call
0812 19:27:06.367427 (+1222565us) ts_tablet_manager.cc:1145] Deleting tablet 4f7febfc2dcc4ec7a164485dbd6cac8b
0812 19:27:06.367460 (+ 33us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:06.367684 (+ 224us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1221693}
I20260812 19:27:06.384950 8636 tablet_bootstrap.cc:654] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.390290 9449 raft_consensus.cc:504] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.400396 8636 tablet_bootstrap.cc:492] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:06.400966 8636 ts_tablet_manager.cc:1397] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.084s user 0.009s sys 0.002s
I20260812 19:27:06.403436 8636 raft_consensus.cc:348] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.412395 8636 raft_consensus.cc:374] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.420380 8636 raft_consensus.cc:729] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.421330 8636 consensus_queue.cc:260] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.350767 8623 raft_consensus.cc:348] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.424403 8623 raft_consensus.cc:374] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.424674 8623 raft_consensus.cc:729] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.425627 8636 ts_tablet_manager.cc:1428] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.024s user 0.004s sys 0.001s
I20260812 19:27:06.425762 8623 consensus_queue.cc:260] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.426653 8636 tablet_bootstrap.cc:492] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:06.430279 8623 ts_tablet_manager.cc:1428] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.094s user 0.004s sys 0.003s
I20260812 19:27:06.443367 8636 tablet_bootstrap.cc:654] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:06.452767 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_c2e56d6bab7a4ae9aeb5725ac10e4c50 [id=525ff469b92d436fba5e9319b7ddb9fc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet c6075b2e46524829962d2b84353013b2 consensus state has no leader
I20260812 19:27:06.455591 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 133d0846cf1244cf91775af0b1ae9118 (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]) successfully deleted
W20260812 19:27:06.457058 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 14e40943867249c58fee943fc8ed3fb0 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 14e40943867249c58fee943fc8ed3fb0 already in progress: creating tablet
I20260812 19:27:06.431137 8623 tablet_bootstrap.cc:492] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:06.458492 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 4f7febfc2dcc4ec7a164485dbd6cac8b because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 4f7febfc2dcc4ec7a164485dbd6cac8b already in progress: creating tablet
I20260812 19:27:06.462286 8636 tablet_bootstrap.cc:492] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:06.462791 8636 ts_tablet_manager.cc:1397] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.036s user 0.007s sys 0.002s
I20260812 19:27:06.391408 8627 tablet_bootstrap.cc:654] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.441071 8281 leader_election.cc:302] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:27:06.463925 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet b73ea5acf663420cbe9236c014d71199 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet b73ea5acf663420cbe9236c014d71199 already in progress: creating tablet
I20260812 19:27:06.464572 9171 raft_consensus.cc:2781] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:06.465070 9171 raft_consensus.cc:686] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
W20260812 19:27:06.465564 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet df369d3c4e004c29ac65c5ecf7f8c4cc because tablet deleting was already in progress. No further retry: Already present: State transition of tablet df369d3c4e004c29ac65c5ecf7f8c4cc already in progress: creating tablet
I20260812 19:27:06.465920 9171 consensus_queue.cc:237] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:06.466666 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 69ca59e00b52437a8d7ef06ebc194af3 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 69ca59e00b52437a8d7ef06ebc194af3 already in progress: creating tablet
W20260812 19:27:06.467566 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet e6ef4b3497284a799d4a4f45d7609e45 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet e6ef4b3497284a799d4a4f45d7609e45 already in progress: creating tablet
I20260812 19:27:06.472330 8636 raft_consensus.cc:348] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.473129 7953 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:06.475344 8636 raft_consensus.cc:374] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.475338 9464 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:06.476555 8636 raft_consensus.cc:729] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.475924 9464 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:06.485034 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:06.487030 8278 leader_election.cc:341] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.487737 9449 leader_election.cc:288] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:06.499869 9464 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:06.501299 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 298 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:06.506222 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 01063b51cc35482c918f74b43fa3ee8f (DEFAULT_TABLE table=default.Table_e3b24459b2554cd3883378cdf0a9fb61 [id=bb604741b9c044d082ffa9daf4fe8d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.507273 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01063b51cc35482c918f74b43fa3ee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.510268 8326 tablet_service.cc:1467] Processing CreateTablet for tablet 311b68f298164090bc9458e3ee16f6cb (DEFAULT_TABLE table=default.Table_3edb2611b0cb4de78624e0ffdf32222c [id=bb9e313afbcf4be9a295e94b16bbecc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.511452 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 311b68f298164090bc9458e3ee16f6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.514170 8484 tablet_service.cc:1467] Processing CreateTablet for tablet 01063b51cc35482c918f74b43fa3ee8f (DEFAULT_TABLE table=default.Table_e3b24459b2554cd3883378cdf0a9fb61 [id=bb604741b9c044d082ffa9daf4fe8d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.515278 8484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01063b51cc35482c918f74b43fa3ee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.484977 8636 consensus_queue.cc:260] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.516961 8479 tablet_service.cc:1467] Processing CreateTablet for tablet 311b68f298164090bc9458e3ee16f6cb (DEFAULT_TABLE table=default.Table_3edb2611b0cb4de78624e0ffdf32222c [id=bb9e313afbcf4be9a295e94b16bbecc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.527432 8636 ts_tablet_manager.cc:1428] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.064s user 0.009s sys 0.000s
I20260812 19:27:06.528105 8330 tablet_service.cc:1467] Processing CreateTablet for tablet e9815f0f40634d83a6c6a33b2ab198df (DEFAULT_TABLE table=default.Table_5286b447ea52443c84d86022710997bc [id=74900250511b43f88349feed817b332d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.529211 8636 tablet_bootstrap.cc:492] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:06.532582 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9815f0f40634d83a6c6a33b2ab198df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.540688 8479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 311b68f298164090bc9458e3ee16f6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.543946 8323 tablet_service.cc:1467] Processing CreateTablet for tablet 5db9e00d07964bde9f769e217236a771 (DEFAULT_TABLE table=default.Table_02dbea084f02412db88eb169e6bb5cf7 [id=d797b2d682e04058b7e8645792516973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.545076 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db9e00d07964bde9f769e217236a771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.546363 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_ae44aac5695a468ba04978ae918c66b4 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 1 got 0
I20260812 19:27:06.546928 8492 tablet_service.cc:1467] Processing CreateTablet for tablet 5db9e00d07964bde9f769e217236a771 (DEFAULT_TABLE table=default.Table_02dbea084f02412db88eb169e6bb5cf7 [id=d797b2d682e04058b7e8645792516973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.547429 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:06.548393 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 13607c1893434a728d989eb1c8c88eea (DEFAULT_TABLE table=default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.548988 8481 tablet_service.cc:1467] Processing CreateTablet for tablet e9815f0f40634d83a6c6a33b2ab198df (DEFAULT_TABLE table=default.Table_5286b447ea52443c84d86022710997bc [id=74900250511b43f88349feed817b332d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.550184 8627 tablet_bootstrap.cc:492] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:06.550640 8627 ts_tablet_manager.cc:1397] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.285s user 0.013s sys 0.000s
I20260812 19:27:06.553205 8627 raft_consensus.cc:348] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.553830 8627 raft_consensus.cc:374] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.554046 8627 raft_consensus.cc:729] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.554826 8627 consensus_queue.cc:260] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.566421 8322 tablet_service.cc:1467] Processing CreateTablet for tablet 13607c1893434a728d989eb1c8c88eea (DEFAULT_TABLE table=default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.567584 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13607c1893434a728d989eb1c8c88eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.580188 8481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9815f0f40634d83a6c6a33b2ab198df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.584619 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13607c1893434a728d989eb1c8c88eea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.557240 9416 raft_consensus.cc:482] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.585563 9416 raft_consensus.cc:504] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.587708 8154 tablet_service.cc:1467] Processing CreateTablet for tablet 01063b51cc35482c918f74b43fa3ee8f (DEFAULT_TABLE table=default.Table_e3b24459b2554cd3883378cdf0a9fb61 [id=bb604741b9c044d082ffa9daf4fe8d74]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.588675 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db9e00d07964bde9f769e217236a771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.590924 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01063b51cc35482c918f74b43fa3ee8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.592810 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 622deb66eead473189ab85a53cb8c81f (DEFAULT_TABLE table=default.Table_87cb1dcf475941269e6d752d00e0df9b [id=9e80dff3c6904e2eb80288a122698ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.594201 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622deb66eead473189ab85a53cb8c81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.594893 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 311b68f298164090bc9458e3ee16f6cb (DEFAULT_TABLE table=default.Table_3edb2611b0cb4de78624e0ffdf32222c [id=bb9e313afbcf4be9a295e94b16bbecc3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.595791 8152 tablet_service.cc:1467] Processing CreateTablet for tablet e9815f0f40634d83a6c6a33b2ab198df (DEFAULT_TABLE table=default.Table_5286b447ea52443c84d86022710997bc [id=74900250511b43f88349feed817b332d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.596177 8148 tablet_service.cc:1467] Processing CreateTablet for tablet 5db9e00d07964bde9f769e217236a771 (DEFAULT_TABLE table=default.Table_02dbea084f02412db88eb169e6bb5cf7 [id=d797b2d682e04058b7e8645792516973]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.596892 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 13607c1893434a728d989eb1c8c88eea (DEFAULT_TABLE table=default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.598538 8623 tablet_bootstrap.cc:654] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.599727 9416 leader_election.cc:288] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:06.601387 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7764a1ae009142b29d5fb574dca45e21" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:06.602928 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7764a1ae009142b29d5fb574dca45e21" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:06.604373 8107 leader_election.cc:341] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:06.604969 8108 leader_election.cc:341] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.605309 8108 leader_election.cc:302] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:06.607573 9255 raft_consensus.cc:2726] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:06.610733 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 622deb66eead473189ab85a53cb8c81f (DEFAULT_TABLE table=default.Table_87cb1dcf475941269e6d752d00e0df9b [id=9e80dff3c6904e2eb80288a122698ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.611999 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622deb66eead473189ab85a53cb8c81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.622957 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 311b68f298164090bc9458e3ee16f6cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.623909 9282 raft_consensus.cc:482] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.624179 8148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db9e00d07964bde9f769e217236a771. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.624797 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9815f0f40634d83a6c6a33b2ab198df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.624359 9282 raft_consensus.cc:504] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.624969 7960 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:06.626266 9282 leader_election.cc:288] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:06.628499 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13607c1893434a728d989eb1c8c88eea. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:06.628468 8443 leader_election.cc:341] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 1bd34ec17d8c4609ad979fab951c8a96
W20260812 19:27:06.629429 8446 leader_election.cc:341] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 1bd34ec17d8c4609ad979fab951c8a96
I20260812 19:27:06.629805 8627 ts_tablet_manager.cc:1428] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.079s user 0.005s sys 0.000s
I20260812 19:27:06.629760 8446 leader_election.cc:302] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:06.630404 9282 raft_consensus.cc:2726] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:06.651247 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:06.651872 8179 raft_consensus.cc:3037] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.663430 8179 raft_consensus.cc:2454] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
W20260812 19:27:06.577780 7777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111) [suppressed 13 similar messages]
I20260812 19:27:06.670063 8281 leader_election.cc:302] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:06.671303 9449 raft_consensus.cc:2781] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:06.672039 9449 raft_consensus.cc:686] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:06.675478 8148 tablet_service.cc:1467] Processing CreateTablet for tablet 622deb66eead473189ab85a53cb8c81f (DEFAULT_TABLE table=default.Table_87cb1dcf475941269e6d752d00e0df9b [id=9e80dff3c6904e2eb80288a122698ec7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:06.676661 8148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 622deb66eead473189ab85a53cb8c81f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:06.681586 8636 tablet_bootstrap.cc:654] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.684662 7956 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067] alter complete (version 2)
W20260812 19:27:06.689491 7777 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 111833us
W20260812 19:27:06.706465 7957 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 37) took 3525 ms (client timeout 1000 ms). Trace:
W20260812 19:27:06.706972 7957 rpcz_store.cc:269] 0812 19:27:03.180994 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.181148 (+ 154us) service_pool.cc:227] Handling call
0812 19:27:06.706195 (+3525047us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":9}
I20260812 19:27:06.707187 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:06.707741 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:06.708866 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet eec275b2131d4848ae120d8a841a1cae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:06.709290 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:51 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:06.712554 9233 tablet_replica.cc:330] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:06.713307 9233 raft_consensus.cc:2229] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:06.713795 9233 raft_consensus.cc:2258] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:06.715603 9233 ts_tablet_manager.cc:1905] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:06.716658 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 133d0846cf1244cf91775af0b1ae9118 because the tablet was not found. No further retry: Not found: Tablet not found: 133d0846cf1244cf91775af0b1ae9118
I20260812 19:27:06.722409 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet da5f9e7431654d5fbae5d554c6f14569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:06.723485 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:06.724809 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:44966
W20260812 19:27:06.732852 7959 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 38) took 2230 ms (client timeout 1000 ms). Trace:
W20260812 19:27:06.733759 7959 rpcz_store.cc:269] 0812 19:27:04.501968 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.520337 (+ 18369us) service_pool.cc:227] Handling call
0812 19:27:04.543426 (+ 23089us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:06.732651 (+2189225us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24452,"reported_tablets":10,"spinlock_wait_cycles":46813952}
W20260812 19:27:06.725080 7953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 39) took 1202 ms (client timeout 1000 ms). Trace:
W20260812 19:27:06.750016 7953 rpcz_store.cc:269] 0812 19:27:05.522144 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:05.559629 (+ 37485us) service_pool.cc:227] Handling call
0812 19:27:06.724910 (+1165281us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17552,"reported_tablets":12}
I20260812 19:27:06.755148 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d660422701a423794416b01cea825b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ff5b2d23d734217b0b10e50834b8883) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.757788 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.757985 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet da5f9e7431654d5fbae5d554c6f14569 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.758483 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:06.758708 7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 31) took 3168 ms (client timeout 1000 ms). Trace:
W20260812 19:27:06.759093 7962 rpcz_store.cc:269] 0812 19:27:03.589989 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:03.590090 (+ 101us) service_pool.cc:227] Handling call
0812 19:27:06.758503 (+3168413us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39600,"reported_tablets":19}
I20260812 19:27:06.767097 8636 tablet_bootstrap.cc:492] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:06.767652 8636 ts_tablet_manager.cc:1397] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.239s user 0.009s sys 0.001s
W20260812 19:27:06.768563 7777 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563): Network error: Client connection negotiation failed: client connection to 127.7.144.253:41563: connect: Connection refused (error 111)
I20260812 19:27:06.769284 7777 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
W20260812 19:27:06.785561 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 106621us
I20260812 19:27:06.786180 9171 consensus_queue.cc:1035] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:06.793108 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet dbafc01c482b493a981aed31ce112885 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:53 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:06.793345 8627 tablet_bootstrap.cc:492] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:06.794530 9451 raft_consensus.cc:482] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.794934 9451 raft_consensus.cc:504] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.800159 8510 raft_consensus.cc:3037] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.802203 9451 leader_election.cc:288] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:06.802911 8321 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:06.803747 8325 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:06.805320 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:06.812520 8332 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d660422701a423794416b01cea825b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ff5b2d23d734217b0b10e50834b8883) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:06.815949 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa599b75d9e4f10b2cbed69b9b9c92b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:06.816246 9449 consensus_queue.cc:237] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.817085 8178 raft_consensus.cc:2454] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:06.817907 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa599b75d9e4f10b2cbed69b9b9c92b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:06.820472 8322 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:44394
W20260812 19:27:06.820613 8278 leader_election.cc:341] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:06.828378 8281 leader_election.cc:302] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:06.770105 8636 raft_consensus.cc:348] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.833868 8636 raft_consensus.cc:374] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:06.834230 8636 raft_consensus.cc:729] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:06.834410 8515 raft_consensus.cc:3037] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.835054 8636 consensus_queue.cc:260] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.848229 9171 raft_consensus.cc:2781] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:06.848750 9171 raft_consensus.cc:482] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:06.849145 9171 raft_consensus.cc:3037] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.868013 9233 ts_tablet_manager.cc:1918] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:06.869542 9233 log.cc:1196] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/4dc5602ff1c24b6ab561389031d89885
I20260812 19:27:06.870883 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.871462 9233 ts_tablet_manager.cc:1939] T 4dc5602ff1c24b6ab561389031d89885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:06.874624 7952 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 242) took 2382 ms. Trace:
I20260812 19:27:06.880177 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 with delete_type TABLET_DATA_DELETED (replaced by tablet a91c4d5adb3d4f97939e38e9cee79532) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.880467 9464 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:06.875094 7952 rpcz_store.cc:276] 0812 19:27:04.490858 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.571298 (+ 80440us) service_pool.cc:227] Handling call
0812 19:27:04.572139 (+ 841us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:04.582323 (+ 10184us) catalog_manager.cc:3616] Apply alter schema
0812 19:27:04.584081 (+ 1758us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:27:04.584289 (+ 208us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:27:04.703501 (+119212us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:27:06.873103 (+2169602us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:04.602375 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:04.602743 (+ 368us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:04.602766 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:27:04.602779 (+ 13us) tablet.cc:660] Decoding operations
0812 19:27:04.603024 (+ 245us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:04.603058 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:04.603080 (+ 22us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:04.603215 (+ 135us) tablet.cc:699] Row locks acquired
0812 19:27:04.603228 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:27:04.603338 (+ 110us) write_op.cc:270] Start()
0812 19:27:04.603417 (+ 79us) write_op.cc:276] Timestamp: P: 1786562824603271 usec, L: 0
0812 19:27:04.603434 (+ 17us) op_driver.cc:331] REPLICATION: starting
0812 19:27:04.603928 (+ 494us) log.cc:842] Serialized 405 byte log entry
0812 19:27:04.701116 (+ 97188us) op_driver.cc:444] REPLICATION: finished
0812 19:27:04.701410 (+ 294us) write_op.cc:301] APPLY: starting
0812 19:27:04.701456 (+ 46us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:04.701527 (+ 71us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:04.701638 (+ 111us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:04.701980 (+ 342us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:04.702093 (+ 113us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:04.702136 (+ 43us) write_op.cc:312] APPLY: finished
0812 19:27:04.702265 (+ 129us) log.cc:842] Serialized 23 byte log entry
0812 19:27:04.703213 (+ 948us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:04.703275 (+ 62us) write_op.cc:454] Released schema lock
0812 19:27:04.703313 (+ 38us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:04.704626 (+ 1313us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:04.704650 (+ 24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18499,"child_traces":[["op",{"apply.queue_time_us":163,"apply.run_cpu_time_us":1354,"apply.run_wall_time_us":3391,"num_ops":1,"prepare.queue_time_us":16545,"prepare.run_cpu_time_us":1732,"prepare.run_wall_time_us":1731,"replication_time_us":97621}]]}
W20260812 19:27:06.885273 7954 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 36) took 2331 ms (client timeout 1000 ms). Trace:
W20260812 19:27:06.893272 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet dbafc01c482b493a981aed31ce112885 because the tablet was not found. No further retry: Not found: Tablet not found: dbafc01c482b493a981aed31ce112885
I20260812 19:27:06.897733 9482 tablet_replica.cc:330] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:06.900347 9482 raft_consensus.cc:2229] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus shutting down.
W20260812 19:27:06.905745 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 32) took 2658 ms (client timeout 1000 ms). Trace:
I20260812 19:27:06.876427 8636 ts_tablet_manager.cc:1428] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.108s user 0.002s sys 0.004s
I20260812 19:27:06.911862 8636 tablet_bootstrap.cc:492] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:06.865185 9444 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:06.939177 8627 tablet_bootstrap.cc:654] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:06.901677 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.902590 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.903301 8156 tablet_service.cc:1514] Processing DeleteTablet for tablet 3740799e07f94fe981d395ef8c3d7973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:55 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.904810 8152 tablet_service.cc:1514] Processing DeleteTablet for tablet a49e46c8ba704680bf12423854883b55 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d07516dc1c4193b4cbd68185f92891) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.909989 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 544d3d74baa6477da11abbee139ee66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.911836 8157 tablet_service.cc:1514] Processing DeleteTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.922015 8623 tablet_bootstrap.cc:492] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:06.933831 8158 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f with delete_type TABLET_DATA_DELETED (replaced by tablet 94407c13a91c4a76bd3aa1c1c8032384) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.938036 8151 tablet_service.cc:1514] Processing DeleteTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc with delete_type TABLET_DATA_DELETED (replaced by tablet c607886a76344185aa9af5da797b9ae8) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:06.942149 8623 ts_tablet_manager.cc:1397] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.511s user 0.008s sys 0.015s
I20260812 19:27:06.934643 9444 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:06.907868 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 4dc5602ff1c24b6ab561389031d89885 (table default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]) successfully deleted
W20260812 19:27:06.964898 7945 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 57049.2us
I20260812 19:27:06.934373 7962 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e5f2201cb9bd40ed8267caf59450abca" } modify_external_catalogs: true
I20260812 19:27:06.965984 7962 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_e5f2201cb9bd40ed8267caf59450abca" } modify_external_catalogs: true
I20260812 19:27:06.966207 9444 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:06.967298 9491 tablet.cc:1722] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:27:06.969954 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:06.971087 8179 raft_consensus.cc:2454] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:06.972652 8281 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:06.973906 9444 raft_consensus.cc:2781] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260812 19:27:06.974879 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 because the tablet was not found. No further retry: Not found: Tablet not found: 22fe32c0d82845b8a9f0c0e4d88f7d39
I20260812 19:27:06.974826 9444 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:06.975451 9444 raft_consensus.cc:3037] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:06.979360 8512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:06.981057 8278 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:06.989164 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 because the tablet was not found. No further retry: Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4
W20260812 19:27:06.991356 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 133d0846cf1244cf91775af0b1ae9118 because the tablet was not found. No further retry: Not found: Tablet not found: 133d0846cf1244cf91775af0b1ae9118
W20260812 19:27:06.993583 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 7d660422701a423794416b01cea825b4 because the tablet was not found. No further retry: Not found: Tablet not found: 7d660422701a423794416b01cea825b4
W20260812 19:27:06.995627 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 1bd34ec17d8c4609ad979fab951c8a96 because the tablet was not found. No further retry: Not found: Tablet not found: 1bd34ec17d8c4609ad979fab951c8a96
W20260812 19:27:06.999125 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet eec275b2131d4848ae120d8a841a1cae because the tablet was not found. No further retry: Not found: Tablet not found: eec275b2131d4848ae120d8a841a1cae
I20260812 19:27:07.000186 9233 tablet_replica.cc:330] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
W20260812 19:27:07.000525 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 453a403d1c0b4b5c8dcd9b93c7cc9ea4 because the tablet was not found. No further retry: Not found: Tablet not found: 453a403d1c0b4b5c8dcd9b93c7cc9ea4
W20260812 19:27:06.885830 7954 rpcz_store.cc:269] 0812 19:27:04.553077 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.557627 (+ 4550us) service_pool.cc:227] Handling call
0812 19:27:06.004422 (+1446795us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:06.004460 (+ 38us) write_op.cc:454] Released schema lock
0812 19:27:06.884385 (+879925us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:05.940078 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:05.940444 (+ 366us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:05.940468 (+ 24us) write_op.cc:435] Acquired schema lock
0812 19:27:05.940480 (+ 12us) tablet.cc:660] Decoding operations
0812 19:27:05.940727 (+ 247us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:05.940761 (+ 34us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:05.940782 (+ 21us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:05.940907 (+ 125us) tablet.cc:699] Row locks acquired
0812 19:27:05.940919 (+ 12us) write_op.cc:260] PREPARE: finished
0812 19:27:05.941014 (+ 95us) write_op.cc:270] Start()
0812 19:27:05.941088 (+ 74us) write_op.cc:276] Timestamp: P: 1786562825940966 usec, L: 0
0812 19:27:05.941103 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:27:05.941566 (+ 463us) log.cc:842] Serialized 533 byte log entry
0812 19:27:05.953870 (+ 12304us) op_driver.cc:444] REPLICATION: finished
0812 19:27:05.955165 (+ 1295us) write_op.cc:301] APPLY: starting
0812 19:27:05.955220 (+ 55us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:05.955317 (+ 97us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:05.955405 (+ 88us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:05.955578 (+ 173us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:05.955706 (+ 128us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:05.955752 (+ 46us) write_op.cc:312] APPLY: finished
0812 19:27:05.955928 (+ 176us) log.cc:842] Serialized 23 byte log entry
0812 19:27:05.956066 (+ 138us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:05.956146 (+ 80us) write_op.cc:454] Released schema lock
0812 19:27:05.956181 (+ 35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":34521,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":1113,"apply.run_cpu_time_us":1251,"apply.run_wall_time_us":1251,"num_ops":1,"prepare.queue_time_us":93,"prepare.run_cpu_time_us":1720,"prepare.run_wall_time_us":1898,"raft.queue_time_us":84,"raft.run_cpu_time_us":10,"raft.run_wall_time_us":11,"replication_time_us":12691}]]}
I20260812 19:27:07.007687 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_fa1fbd614aec4990a05779a0217a0431"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:07.009804 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_fa1fbd614aec4990a05779a0217a0431 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:07.014252 9233 raft_consensus.cc:2229] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:07.016177 9233 raft_consensus.cc:2258] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:07.020076 9469 raft_consensus.cc:482] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.020749 9469 raft_consensus.cc:504] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.026175 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:07.028173 8107 leader_election.cc:341] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.028628 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:07.029858 9233 ts_tablet_manager.cc:1905] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:07.030174 8108 leader_election.cc:341] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.030599 8108 leader_election.cc:302] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:07.030876 8636 tablet_bootstrap.cc:654] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.031383 9255 raft_consensus.cc:2726] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:06.999665 9171 raft_consensus.cc:504] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.011229 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 2 got 0
W20260812 19:27:07.011932 7958 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 34) took 1614 ms (client timeout 1000 ms). Trace:
I20260812 19:27:07.051604 8636 tablet_bootstrap.cc:492] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:07.052112 8636 ts_tablet_manager.cc:1397] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.143s user 0.020s sys 0.005s
W20260812 19:27:07.051836 7958 rpcz_store.cc:269] 0812 19:27:05.396525 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:05.415402 (+ 18877us) service_pool.cc:227] Handling call
0812 19:27:07.011053 (+1595651us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2382,"reported_tablets":31}
I20260812 19:27:07.056447 9171 leader_election.cc:288] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:07.057612 8636 raft_consensus.cc:348] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.057761 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa599b75d9e4f10b2cbed69b9b9c92b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:07.058571 8636 raft_consensus.cc:374] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.058871 8636 raft_consensus.cc:729] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.058791 8179 raft_consensus.cc:3037] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:07.059510 8636 consensus_queue.cc:260] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.015345 9492 tablet.cc:1722] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:27:07.061466 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6aa599b75d9e4f10b2cbed69b9b9c92b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:06.994199 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8bffdbff44404a2b8b9c8e52e0326496"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:07.064554 8636 ts_tablet_manager.cc:1428] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.012s user 0.007s sys 0.001s
W20260812 19:27:07.073441 8278 leader_election.cc:341] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.074709 8636 tablet_bootstrap.cc:492] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:07.046036 9469 leader_election.cc:288] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:07.091367 8636 tablet_bootstrap.cc:654] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.091323 8627 tablet_bootstrap.cc:492] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:07.091851 8627 ts_tablet_manager.cc:1397] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.461s user 0.015s sys 0.010s
W20260812 19:27:07.096282 9486 log.cc:924] Time spent T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.053s user 0.001s sys 0.000s
I20260812 19:27:07.096639 8627 raft_consensus.cc:348] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.097892 8627 raft_consensus.cc:374] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.098215 8627 raft_consensus.cc:729] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.099255 8627 consensus_queue.cc:260] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.106940 9233 ts_tablet_manager.cc:1918] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:07.107445 9233 log.cc:1196] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/da5f9e7431654d5fbae5d554c6f14569
I20260812 19:27:07.108317 9233 ts_tablet_manager.cc:1939] T da5f9e7431654d5fbae5d554c6f14569 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:07.110491 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
W20260812 19:27:07.110648 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8bffdbff44404a2b8b9c8e52e0326496 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:07.108117 9482 raft_consensus.cc:2258] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:07.111048 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:07.113193 9482 ts_tablet_manager.cc:1905] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:07.120664 9233 tablet_replica.cc:330] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:07.121497 9233 raft_consensus.cc:2229] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:07.122001 9233 raft_consensus.cc:2258] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:07.127125 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:07.129217 8627 ts_tablet_manager.cc:1428] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.037s user 0.002s sys 0.007s
I20260812 19:27:07.103926 8623 raft_consensus.cc:348] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.129690 8623 raft_consensus.cc:374] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.130005 8623 raft_consensus.cc:729] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.130708 8623 consensus_queue.cc:260] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.134876 9233 ts_tablet_manager.cc:1905] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:07.134922 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_bcd87c04648c489e9d444bbc8470ccd7"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:07.157315 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet da5f9e7431654d5fbae5d554c6f14569 (table default.Table_ad6af655b663482b88244d72f58c34c0 [id=a703135c7fcc446fba1a069bbf4c3b96]) successfully deleted
I20260812 19:27:07.157811 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet 4dc5602ff1c24b6ab561389031d89885 with delete_type TABLET_DATA_DELETED (replaced by tablet 30940fe1277e4347941f3525f6448cdb) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:07.158825 7955 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 255) took 1618 ms. Trace:
I20260812 19:27:07.161031 8623 ts_tablet_manager.cc:1428] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.218s user 0.004s sys 0.003s
W20260812 19:27:07.164556 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_bcd87c04648c489e9d444bbc8470ccd7 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:27:07.165390 7993 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2600 after lost signal to thread 7921
W20260812 19:27:07.166676 7993 debug-util.cc:398] Leaking SignalData structure 0x7b08000bb460 after lost signal to thread 7999
I20260812 19:27:07.159160 7955 rpcz_store.cc:276] 0812 19:27:05.539624 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:05.971991 (+432367us) service_pool.cc:227] Handling call
0812 19:27:06.227839 (+255848us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:27:06.467198 (+239359us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:27:07.011740 (+544542us) catalog_manager.cc:2181] Wrote table and tablets to system table
0812 19:27:07.130799 (+119059us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0812 19:27:07.157909 (+ 27110us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:06.508698 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:06.509340 (+ 642us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:06.509388 (+ 48us) write_op.cc:435] Acquired schema lock
0812 19:27:06.509424 (+ 36us) tablet.cc:660] Decoding operations
0812 19:27:06.509875 (+ 451us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:06.509969 (+ 94us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:06.510012 (+ 43us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:06.510407 (+ 395us) tablet.cc:699] Row locks acquired
0812 19:27:06.510441 (+ 34us) write_op.cc:260] PREPARE: finished
0812 19:27:06.510605 (+ 164us) write_op.cc:270] Start()
0812 19:27:06.510788 (+ 183us) write_op.cc:276] Timestamp: P: 1786562826510475 usec, L: 0
0812 19:27:06.510826 (+ 38us) op_driver.cc:331] REPLICATION: starting
0812 19:27:06.511757 (+ 931us) log.cc:842] Serialized 433 byte log entry
0812 19:27:06.738616 (+226859us) op_driver.cc:444] REPLICATION: finished
0812 19:27:06.865344 (+126728us) write_op.cc:301] APPLY: starting
0812 19:27:06.865524 (+ 180us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:06.866071 (+ 547us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:06.866421 (+ 350us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:06.867877 (+ 1456us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:06.915516 (+ 47639us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 19:27:06.915648 (+ 132us) write_op.cc:312] APPLY: finished
0812 19:27:06.916050 (+ 402us) log.cc:842] Serialized 29 byte log entry
0812 19:27:07.008567 (+ 92517us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.008778 (+ 211us) write_op.cc:454] Released schema lock
0812 19:27:07.008897 (+ 119us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:07.109424 (+100527us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.116446 (+ 7022us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":126282,"apply.run_cpu_time_us":5301,"apply.run_wall_time_us":253459,"num_ops":2,"prepare.queue_time_us":39124,"prepare.run_cpu_time_us":3545,"prepare.run_wall_time_us":3544,"raft.queue_time_us":14072,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":11,"replication_time_us":227694,"thread_start_us":132761,"threads_started":1}]]}
I20260812 19:27:07.173373 9233 ts_tablet_manager.cc:1918] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:07.175836 9233 log.cc:1196] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/dbafc01c482b493a981aed31ce112885
I20260812 19:27:07.176657 9233 ts_tablet_manager.cc:1939] T dbafc01c482b493a981aed31ce112885 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
W20260812 19:27:07.175197 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 37) took 1606 ms (client timeout 1000 ms). Trace:
I20260812 19:27:07.134383 9483 tablet_replica.cc:330] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:07.174947 7955 master_service.cc:946] ReplaceTablet: received request to replace tablet b73ea5acf663420cbe9236c014d71199 from {username='slave'} at 127.0.0.1:46888
W20260812 19:27:07.187105 7960 rpcz_store.cc:269] 0812 19:27:05.568863 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:05.811303 (+242440us) service_pool.cc:227] Handling call
0812 19:27:07.175054 (+1363751us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":164965,"reported_tablets":23}
I20260812 19:27:07.192061 9501 tablet.cc:1722] T e03513e6d6bc4e7ba5dfc355ccc0cb0f P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 2
I20260812 19:27:07.189281 8179 raft_consensus.cc:2454] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:07.194543 8281 leader_election.cc:302] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:07.209816 7957 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_771c0d6e0724423f812f274ab0c28078" } modify_external_catalogs: true
I20260812 19:27:07.210141 8627 tablet_bootstrap.cc:492] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:07.210407 7957 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_771c0d6e0724423f812f274ab0c28078" } modify_external_catalogs: true
I20260812 19:27:07.196976 8623 tablet_bootstrap.cc:492] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:07.211498 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet dbafc01c482b493a981aed31ce112885 (table default.Table_becd7e0ffc7a45f28e5cdf225a55abbb [id=9c67f412032b44b583e41a660ed0329e]) successfully deleted
W20260812 19:27:07.212292 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 133d0846cf1244cf91775af0b1ae9118 because the tablet was not found. No further retry: Not found: Tablet not found: 133d0846cf1244cf91775af0b1ae9118
W20260812 19:27:07.212813 7945 catalog_manager.cc:4808] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 4dc5602ff1c24b6ab561389031d89885 because the tablet was not found. No further retry: Not found: Tablet not found: 4dc5602ff1c24b6ab561389031d89885
W20260812 19:27:06.989531 7956 rpcz_store.cc:269] 0812 19:27:04.247738 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:04.268656 (+ 20918us) service_pool.cc:227] Handling call
0812 19:27:06.905656 (+2637000us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:04.722508 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:04.722913 (+ 405us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:04.722937 (+ 24us) write_op.cc:435] Acquired schema lock
0812 19:27:04.722950 (+ 13us) tablet.cc:660] Decoding operations
0812 19:27:04.723245 (+ 295us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:04.723284 (+ 39us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:04.723305 (+ 21us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:04.723588 (+ 283us) tablet.cc:699] Row locks acquired
0812 19:27:04.723602 (+ 14us) write_op.cc:260] PREPARE: finished
0812 19:27:04.723722 (+ 120us) write_op.cc:270] Start()
0812 19:27:04.723823 (+ 101us) write_op.cc:276] Timestamp: P: 1786562824723641 usec, L: 0
0812 19:27:04.723843 (+ 20us) op_driver.cc:331] REPLICATION: starting
0812 19:27:04.724380 (+ 537us) log.cc:842] Serialized 913 byte log entry
0812 19:27:04.906770 (+182390us) op_driver.cc:444] REPLICATION: finished
0812 19:27:04.907199 (+ 429us) write_op.cc:301] APPLY: starting
0812 19:27:04.907263 (+ 64us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:04.907373 (+ 110us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:04.907466 (+ 93us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:04.907706 (+ 240us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:04.907814 (+ 108us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:04.907858 (+ 44us) write_op.cc:312] APPLY: finished
0812 19:27:04.908013 (+ 155us) log.cc:842] Serialized 29 byte log entry
0812 19:27:04.908183 (+ 170us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:04.908249 (+ 66us) write_op.cc:454] Released schema lock
0812 19:27:04.908301 (+ 52us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:04.908467 (+ 166us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:04.908490 (+ 23us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 19:27:04.919734 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:04.920051 (+ 317us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:04.920074 (+ 23us) write_op.cc:435] Acquired schema lock
0812 19:27:04.920086 (+ 12us) tablet.cc:660] Decoding operations
0812 19:27:04.920359 (+ 273us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:04.920391 (+ 32us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:04.920412 (+ 21us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:04.920543 (+ 131us) tablet.cc:699] Row locks acquired
0812 19:27:04.920556 (+ 13us) write_op.cc:260] PREPARE: finished
0812 19:27:04.920663 (+ 107us) write_op.cc:270] Start()
0812 19:27:04.920740 (+ 77us) write_op.cc:276] Timestamp: P: 1786562824920611 usec, L: 0
0812 19:27:04.920755 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:27:05.065848 (+145093us) log.cc:842] Serialized 356 byte log entry
0812 19:27:05.067540 (+ 1692us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64471 00007f05eeedb198 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9 00007f05ef340ab1 00007f05ef33fdad 0000000000580784 00000000005805b9
0812 19:27:05.327987 (+260447us) op_driver.cc:444] REPLICATION: finished
0812 19:27:05.329493 (+ 1506us) write_op.cc:301] APPLY: starting
0812 19:27:05.329548 (+ 55us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:05.329644 (+ 96us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:05.329674 (+ 30us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:05.329826 (+ 152us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:05.329964 (+ 138us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:05.330006 (+ 42us) write_op.cc:312] APPLY: finished
0812 19:27:05.330207 (+ 201us) log.cc:842] Serialized 23 byte log entry
0812 19:27:05.330357 (+ 150us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:05.330429 (+ 72us) write_op.cc:454] Released schema lock
0812 19:27:05.330464 (+ 35us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:05.330649 (+ 185us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:05.330682 (+ 33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":28442,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":1481,"apply.run_wall_time_us":1481,"num_ops":2,"prepare.queue_time_us":54151,"prepare.run_cpu_time_us":2100,"prepare.run_wall_time_us":2100,"replication_time_us":182854}],["op",{"apply.queue_time_us":1346,"apply.run_cpu_time_us":1346,"apply.run_wall_time_us":1345,"num_ops":1,"prepare.queue_time_us":6326,"prepare.run_cpu_time_us":4542,"prepare.run_wall_time_us":147933,"replication_time_us":407162,"spinlock_wait_cycles":332216576}]]}
I20260812 19:27:07.214628 7956 master_service.cc:946] ReplaceTablet: received request to replace tablet 384506029b4e49639f87f6d7005fa0a9 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:07.199822 9449 raft_consensus.cc:2781] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:07.219599 7955 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:46888 (request call id 260) took 1359 ms. Trace:
I20260812 19:27:07.225929 9449 raft_consensus.cc:686] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:07.226931 9449 consensus_queue.cc:237] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.227836 8481 tablet_service.cc:1514] Processing DeleteTablet for tablet 1bd34ec17d8c4609ad979fab951c8a96 with delete_type TABLET_DATA_DELETED (replaced by tablet c6075b2e46524829962d2b84353013b2) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:07.228565 9233 tablet_replica.cc:330] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:07.229349 9233 raft_consensus.cc:2229] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:07.229780 9233 raft_consensus.cc:2258] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:07.230356 8328 tablet_service.cc:1514] Processing DeleteTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:07.232157 9451 raft_consensus.cc:482] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.232718 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 133d0846cf1244cf91775af0b1ae9118 with delete_type TABLET_DATA_DELETED (replaced by tablet 7b689d49a1244c7fb12ba84853f2da9d) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:07.233393 8323 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:07.233335 7960 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_cf8b0698da1e4cdb8c505f5337faa983" } new_table_name: "default.Table_5d48b4b4f8cb4a1e84677661d3407119" modify_external_catalogs: true
I20260812 19:27:07.234076 8322 tablet_service.cc:1514] Processing DeleteTablet for tablet 3740799e07f94fe981d395ef8c3d7973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:55 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:07.232313 8330 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:07.231545 9233 ts_tablet_manager.cc:1905] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:07.232738 9451 raft_consensus.cc:504] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.242528 9451 leader_election.cc:288] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:07.220088 7955 rpcz_store.cc:276] 0812 19:27:05.859801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.173872 (+1314071us) service_pool.cc:227] Handling call
0812 19:27:07.219382 (+ 45510us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:07.247289 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "544d3d74baa6477da11abbee139ee66f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:07.247541 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "544d3d74baa6477da11abbee139ee66f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:07.249266 8179 raft_consensus.cc:2454] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:07.250986 8281 leader_election.cc:302] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:07.255671 7956 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:46888 (request call id 263) took 1007 ms. Trace:
I20260812 19:27:07.255753 9171 raft_consensus.cc:2781] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:07.256138 7956 rpcz_store.cc:276] 0812 19:27:06.248430 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.214388 (+965958us) service_pool.cc:227] Handling call
0812 19:27:07.255603 (+ 41215us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:07.256515 9171 raft_consensus.cc:482] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:07.257153 9171 raft_consensus.cc:3037] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:07.257483 7956 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_c2e56d6bab7a4ae9aeb5725ac10e4c50" } new_table_name: "default.Table_f012e6c4368d4fcea457cb5be9a8750a" modify_external_catalogs: true
I20260812 19:27:07.251025 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet a49e46c8ba704680bf12423854883b55 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d07516dc1c4193b4cbd68185f92891) from {username='slave'} at 127.0.0.1:44394
W20260812 19:27:07.262797 8278 consensus_peers.cc:487] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:07.263696 8278 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.266737 9469 raft_consensus.cc:482] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.267364 9469 raft_consensus.cc:504] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.273880 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:07.275719 8107 leader_election.cc:341] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.280562 7955 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:07.281503 7955 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:07.288961 9469 leader_election.cc:288] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:07.291653 8636 tablet_bootstrap.cc:492] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:07.292049 8636 ts_tablet_manager.cc:1397] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.218s user 0.015s sys 0.039s
I20260812 19:27:07.295452 8636 raft_consensus.cc:348] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.296093 8636 raft_consensus.cc:374] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.296344 8636 raft_consensus.cc:729] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.298805 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:07.302798 8108 leader_election.cc:341] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.303284 8108 leader_election.cc:302] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:07.303815 9233 ts_tablet_manager.cc:1918] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:07.304153 9233 log.cc:1196] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/1bd34ec17d8c4609ad979fab951c8a96
I20260812 19:27:07.304884 9233 ts_tablet_manager.cc:1939] T 1bd34ec17d8c4609ad979fab951c8a96 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:07.305653 8627 tablet_bootstrap.cc:654] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.307521 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 1bd34ec17d8c4609ad979fab951c8a96 (table default.Table_c2e56d6bab7a4ae9aeb5725ac10e4c50 [id=525ff469b92d436fba5e9319b7ddb9fc]) successfully deleted
I20260812 19:27:07.307426 9469 raft_consensus.cc:2726] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:07.308904 8636 consensus_queue.cc:260] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.322082 8623 tablet_bootstrap.cc:654] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.323158 8636 ts_tablet_manager.cc:1428] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.031s user 0.006s sys 0.000s
I20260812 19:27:07.326030 9513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.253:41563 every 8 connection(s)
I20260812 19:27:07.328815 8849 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.253:41563
I20260812 19:27:07.311955 9483 raft_consensus.cc:2229] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:07.332899 8636 tablet_bootstrap.cc:492] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:07.338171 9282 raft_consensus.cc:482] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.338783 9282 raft_consensus.cc:504] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.342226 9282 leader_election.cc:288] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:07.345494 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22fe32c0d82845b8a9f0c0e4d88f7d39" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:07.347898 8443 leader_election.cc:341] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 22fe32c0d82845b8a9f0c0e4d88f7d39
I20260812 19:27:07.343963 9171 raft_consensus.cc:504] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.350281 8849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
I20260812 19:27:07.352083 8446 leader_election.cc:302] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:07.354085 9483 raft_consensus.cc:2258] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:07.355880 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 8849
I20260812 19:27:07.356642 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "544d3d74baa6477da11abbee139ee66f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:07.358878 9282 raft_consensus.cc:2726] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:07.363261 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "544d3d74baa6477da11abbee139ee66f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:07.363984 8179 raft_consensus.cc:3037] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:07.369882 8636 tablet_bootstrap.cc:654] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:07.358461 8278 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.369160 9171 leader_election.cc:288] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:07.374439 9483 ts_tablet_manager.cc:1905] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:07.376765 8179 raft_consensus.cc:2454] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:07.386739 8627 tablet_bootstrap.cc:492] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:07.387305 8627 ts_tablet_manager.cc:1397] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.177s user 0.004s sys 0.016s
I20260812 19:27:07.389701 8627 raft_consensus.cc:348] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.390473 8627 raft_consensus.cc:374] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.390854 8627 raft_consensus.cc:729] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.391613 8627 consensus_queue.cc:260] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.400852 8636 tablet_bootstrap.cc:492] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:07.401682 8636 ts_tablet_manager.cc:1397] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.069s user 0.010s sys 0.002s
I20260812 19:27:07.378235 9444 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.397012 8281 leader_election.cc:302] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:07.409802 9449 raft_consensus.cc:2781] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:07.410240 9449 raft_consensus.cc:686] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:07.411015 9449 consensus_queue.cc:237] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.413048 8636 raft_consensus.cc:348] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:07.413688 8636 raft_consensus.cc:374] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.413916 8636 raft_consensus.cc:729] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.418833 8636 consensus_queue.cc:260] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:07.419742 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:07.421537 8278 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.423992 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:07.424822 8178 raft_consensus.cc:3037] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:07.426705 7954 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 258) took 1697 ms. Trace:
I20260812 19:27:07.427139 7954 rpcz_store.cc:276] 0812 19:27:05.729200 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.007067 (+1277867us) service_pool.cc:227] Handling call
0812 19:27:07.120428 (+113361us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:27:07.144738 (+ 24310us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:27:07.425462 (+280724us) catalog_manager.cc:2181] Wrote table and tablets to system table
0812 19:27:07.426132 (+ 670us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0812 19:27:07.426594 (+ 462us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:07.201589 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:07.202483 (+ 894us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:07.202537 (+ 54us) write_op.cc:435] Acquired schema lock
0812 19:27:07.202589 (+ 52us) tablet.cc:660] Decoding operations
0812 19:27:07.203323 (+ 734us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:07.203482 (+ 159us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:07.203543 (+ 61us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:07.204068 (+ 525us) tablet.cc:699] Row locks acquired
0812 19:27:07.204124 (+ 56us) write_op.cc:260] PREPARE: finished
0812 19:27:07.236860 (+ 32736us) write_op.cc:270] Start()
0812 19:27:07.237077 (+ 217us) write_op.cc:276] Timestamp: P: 1786562827236752 usec, L: 0
0812 19:27:07.237095 (+ 18us) op_driver.cc:331] REPLICATION: starting
0812 19:27:07.238300 (+ 1205us) log.cc:842] Serialized 433 byte log entry
0812 19:27:07.421988 (+183688us) op_driver.cc:444] REPLICATION: finished
0812 19:27:07.422362 (+ 374us) write_op.cc:301] APPLY: starting
0812 19:27:07.422481 (+ 119us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:07.422700 (+ 219us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:07.422948 (+ 248us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:07.423770 (+ 822us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:07.424006 (+ 236us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 19:27:07.424098 (+ 92us) write_op.cc:312] APPLY: finished
0812 19:27:07.424472 (+ 374us) log.cc:842] Serialized 29 byte log entry
0812 19:27:07.424752 (+ 280us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.424860 (+ 108us) write_op.cc:454] Released schema lock
0812 19:27:07.424974 (+ 114us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":112,"apply.run_cpu_time_us":3450,"apply.run_wall_time_us":6520,"num_ops":2,"prepare.queue_time_us":45745,"prepare.run_cpu_time_us":4929,"prepare.run_wall_time_us":37280,"raft.queue_time_us":231,"raft.run_cpu_time_us":1409,"raft.run_wall_time_us":7249,"replication_time_us":184659,"thread_start_us":32575,"threads_started":1}]]}
I20260812 19:27:07.437075 8636 ts_tablet_manager.cc:1428] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.035s user 0.002s sys 0.003s
W20260812 19:27:07.443955 8278 consensus_peers.cc:487] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:07.444587 9444 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:07.447413 8627 ts_tablet_manager.cc:1428] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.060s user 0.005s sys 0.000s
I20260812 19:27:07.448488 8627 tablet_bootstrap.cc:492] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:07.450425 8636 tablet_bootstrap.cc:492] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:07.454890 9483 ts_tablet_manager.cc:1918] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:07.456887 9483 log.cc:1196] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/863e7ca808f54a989b3372aa4bfe361e
I20260812 19:27:07.459159 9444 consensus_queue.cc:1035] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:07.458657 9483 ts_tablet_manager.cc:1939] T 863e7ca808f54a989b3372aa4bfe361e P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:07.468775 9482 ts_tablet_manager.cc:1918] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:07.469480 9482 log.cc:1196] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/7d660422701a423794416b01cea825b4
I20260812 19:27:07.470613 9482 ts_tablet_manager.cc:1939] T 7d660422701a423794416b01cea825b4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:07.473627 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 7d660422701a423794416b01cea825b4 (table default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]) successfully deleted
I20260812 19:27:07.480926 9483 tablet_replica.cc:330] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:07.482107 9483 raft_consensus.cc:2229] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:07.483374 9483 pending_rounds.cc:62] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Trying to abort 1 pending ops.
I20260812 19:27:07.483954 9483 pending_rounds.cc:68] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761338655461376 op_type: NO_OP noop_request { }
I20260812 19:27:07.484814 9483 raft_consensus.cc:2866] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:07.485509 9483 raft_consensus.cc:2258] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:07.488511 9483 ts_tablet_manager.cc:1905] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:07.461171 8178 raft_consensus.cc:2454] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:07.516674 8281 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:07.518132 9449 raft_consensus.cc:2781] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:07.518858 9449 raft_consensus.cc:686] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:07.521311 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_7eb7a40f96734c5181c10b7d4f997beb"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:27:07.521294 9449 consensus_queue.cc:237] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.525098 9483 ts_tablet_manager.cc:1918] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:07.525676 9483 log.cc:1196] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/a84bf28a3e174f3b88f8758b09ced1f1
I20260812 19:27:07.526887 9483 ts_tablet_manager.cc:1939] T a84bf28a3e174f3b88f8758b09ced1f1 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:07.484522 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 863e7ca808f54a989b3372aa4bfe361e (table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]) successfully deleted
W20260812 19:27:07.527149 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_7eb7a40f96734c5181c10b7d4f997beb in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:07.531241 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet a84bf28a3e174f3b88f8758b09ced1f1 (table default.Table_cb47cf36fb124675bbc53c97d2faecd9 [id=43e5a15fbb7d46c6b6ddba3a51cac6e0]) successfully deleted
I20260812 19:27:07.532658 9282 raft_consensus.cc:482] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.533547 9282 raft_consensus.cc:504] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:07.535624 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 133d0846cf1244cf91775af0b1ae9118 because the tablet was not found. No further retry: Not found: Tablet not found: 133d0846cf1244cf91775af0b1ae9118
W20260812 19:27:07.538290 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 because the tablet was not found. No further retry: Not found: Tablet not found: 22fe32c0d82845b8a9f0c0e4d88f7d39
I20260812 19:27:07.541276 7953 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 256) took 1990 ms. Trace:
I20260812 19:27:07.541715 7953 rpcz_store.cc:276] 0812 19:27:05.551287 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.752364 (+1201077us) service_pool.cc:227] Handling call
0812 19:27:06.993991 (+241627us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf156 00007f05ee9ec034 00007f05ee9ebfc2 00007f05ee9ebef1 00007f05ee9ebe6c 00007f05ee9eb122 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:07.120324 (+126333us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:27:07.242770 (+122446us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:27:07.540405 (+297635us) catalog_manager.cc:2181] Wrote table and tablets to system table
0812 19:27:07.540839 (+ 434us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0812 19:27:07.541154 (+ 315us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:07.264742 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:07.271099 (+ 6357us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:07.271162 (+ 63us) write_op.cc:435] Acquired schema lock
0812 19:27:07.271209 (+ 47us) tablet.cc:660] Decoding operations
0812 19:27:07.271823 (+ 614us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:07.271906 (+ 83us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:07.271953 (+ 47us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:07.272453 (+ 500us) tablet.cc:699] Row locks acquired
0812 19:27:07.272467 (+ 14us) write_op.cc:260] PREPARE: finished
0812 19:27:07.272760 (+ 293us) write_op.cc:270] Start()
0812 19:27:07.272925 (+ 165us) write_op.cc:276] Timestamp: P: 1786562827272649 usec, L: 0
0812 19:27:07.272970 (+ 45us) op_driver.cc:331] REPLICATION: starting
0812 19:27:07.273822 (+ 852us) log.cc:842] Serialized 433 byte log entry
0812 19:27:07.526729 (+252907us) op_driver.cc:444] REPLICATION: finished
0812 19:27:07.536767 (+ 10038us) write_op.cc:301] APPLY: starting
0812 19:27:07.536860 (+ 93us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:07.537114 (+ 254us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:07.537371 (+ 257us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:07.538211 (+ 840us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:07.538516 (+ 305us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 19:27:07.538582 (+ 66us) write_op.cc:312] APPLY: finished
0812 19:27:07.538934 (+ 352us) log.cc:842] Serialized 29 byte log entry
0812 19:27:07.539159 (+ 225us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.540042 (+ 883us) write_op.cc:454] Released schema lock
0812 19:27:07.540126 (+ 84us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":273586432,"child_traces":[["op",{"apply.queue_time_us":168,"apply.run_cpu_time_us":3422,"apply.run_wall_time_us":8315,"num_ops":2,"prepare.queue_time_us":20446,"prepare.run_cpu_time_us":4248,"prepare.run_wall_time_us":33967,"replication_time_us":253423}]]}
I20260812 19:27:07.558284 9282 leader_election.cc:288] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:07.559598 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30940fe1277e4347941f3525f6448cdb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:07.559689 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30940fe1277e4347941f3525f6448cdb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:07.562839 7958 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 259) took 1789 ms. Trace:
I20260812 19:27:07.563099 8446 leader_election.cc:302] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:07.564345 9282 raft_consensus.cc:2726] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:07.565089 8636 tablet_bootstrap.cc:654] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.563148 7958 rpcz_store.cc:276] 0812 19:27:05.773861 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.053871 (+1280010us) service_pool.cc:227] Handling call
0812 19:27:07.169201 (+115330us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:27:07.244413 (+ 75212us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:27:07.562245 (+317832us) catalog_manager.cc:2181] Wrote table and tablets to system table
0812 19:27:07.562544 (+ 299us) catalog_manager.cc:2215] Inserted table and tablets into CatalogManager maps
0812 19:27:07.562784 (+ 240us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:07.298883 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:07.299759 (+ 876us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:07.299839 (+ 80us) write_op.cc:435] Acquired schema lock
0812 19:27:07.299861 (+ 22us) tablet.cc:660] Decoding operations
0812 19:27:07.323189 (+ 23328us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:07.323355 (+ 166us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:07.323404 (+ 49us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:07.323860 (+ 456us) tablet.cc:699] Row locks acquired
0812 19:27:07.323887 (+ 27us) write_op.cc:260] PREPARE: finished
0812 19:27:07.324161 (+ 274us) write_op.cc:270] Start()
0812 19:27:07.326069 (+ 1908us) write_op.cc:276] Timestamp: P: 1786562827324079 usec, L: 0
0812 19:27:07.332848 (+ 6779us) op_driver.cc:331] REPLICATION: starting
0812 19:27:07.416833 (+ 83985us) log.cc:842] Serialized 433 byte log entry
0812 19:27:07.557739 (+140906us) op_driver.cc:444] REPLICATION: finished
0812 19:27:07.558103 (+ 364us) write_op.cc:301] APPLY: starting
0812 19:27:07.558209 (+ 106us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:07.558418 (+ 209us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:07.558601 (+ 183us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:07.559529 (+ 928us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:07.559852 (+ 323us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=0
0812 19:27:07.559949 (+ 97us) write_op.cc:312] APPLY: finished
0812 19:27:07.560362 (+ 413us) log.cc:842] Serialized 29 byte log entry
0812 19:27:07.561739 (+ 1377us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.561937 (+ 198us) write_op.cc:454] Released schema lock
0812 19:27:07.562003 (+ 66us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"spinlock_wait_cycles":1462656,"child_traces":[["op",{"apply.queue_time_us":127,"num_ops":2,"prepare.queue_time_us":53047,"prepare.run_cpu_time_us":4847,"prepare.run_wall_time_us":118501,"raft.queue_time_us":71638,"raft.run_cpu_time_us":1392,"raft.run_wall_time_us":2331,"replication_time_us":224604}]]}
I20260812 19:27:07.570250 8623 tablet_bootstrap.cc:492] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:07.570804 8623 ts_tablet_manager.cc:1397] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.374s user 0.016s sys 0.001s
I20260812 19:27:07.574812 8623 raft_consensus.cc:348] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.596342 9282 raft_consensus.cc:482] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.597131 9282 raft_consensus.cc:504] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.601378 9282 leader_election.cc:288] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:07.606559 8510 raft_consensus.cc:3037] T 30940fe1277e4347941f3525f6448cdb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:07.609319 8623 raft_consensus.cc:374] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:27:07.608981 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 1bd34ec17d8c4609ad979fab951c8a96 because the tablet was not found. No further retry: Not found: Tablet not found: 1bd34ec17d8c4609ad979fab951c8a96
I20260812 19:27:07.610109 8623 raft_consensus.cc:729] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
W20260812 19:27:07.611243 8446 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 7d660422701a423794416b01cea825b4
W20260812 19:27:07.613265 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet da5f9e7431654d5fbae5d554c6f14569 because the tablet was not found. No further retry: Not found: Tablet not found: da5f9e7431654d5fbae5d554c6f14569
I20260812 19:27:07.614677 8623 consensus_queue.cc:260] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:07.626053 7948 catalog_manager.cc:4808] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): delete failed for tablet 133d0846cf1244cf91775af0b1ae9118 because the tablet was not found. No further retry: Not found: Tablet not found: 133d0846cf1244cf91775af0b1ae9118
I20260812 19:27:07.629350 8623 ts_tablet_manager.cc:1428] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.058s user 0.002s sys 0.005s
W20260812 19:27:07.634013 7960 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet fac74fcb73d1489f8542496293d6141c has no consensus state
I20260812 19:27:07.634652 7960 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 261) took 1504 ms. Trace:
I20260812 19:27:07.634935 7960 rpcz_store.cc:276] 0812 19:27:06.130105 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.192442 (+1062337us) service_pool.cc:227] Handling call
0812 19:27:07.234009 (+ 41567us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:07.235736 (+ 1727us) catalog_manager.cc:3616] Apply alter schema
0812 19:27:07.276560 (+ 40824us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:27:07.276918 (+ 358us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:27:07.599096 (+322178us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:27:07.634538 (+ 35442us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:07.417852 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:07.418908 (+ 1056us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:07.418979 (+ 71us) write_op.cc:435] Acquired schema lock
0812 19:27:07.418997 (+ 18us) tablet.cc:660] Decoding operations
0812 19:27:07.419590 (+ 593us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:07.419707 (+ 117us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:07.419764 (+ 57us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:07.420053 (+ 289us) tablet.cc:699] Row locks acquired
0812 19:27:07.420084 (+ 31us) write_op.cc:260] PREPARE: finished
0812 19:27:07.420292 (+ 208us) write_op.cc:270] Start()
0812 19:27:07.420462 (+ 170us) write_op.cc:276] Timestamp: P: 1786562827420174 usec, L: 0
0812 19:27:07.420477 (+ 15us) op_driver.cc:331] REPLICATION: starting
0812 19:27:07.421472 (+ 995us) log.cc:842] Serialized 405 byte log entry
0812 19:27:07.592785 (+171313us) op_driver.cc:444] REPLICATION: finished
0812 19:27:07.593226 (+ 441us) write_op.cc:301] APPLY: starting
0812 19:27:07.593331 (+ 105us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:07.593542 (+ 211us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:07.595950 (+ 2408us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:07.596345 (+ 395us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:07.596629 (+ 284us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:07.596717 (+ 88us) write_op.cc:312] APPLY: finished
0812 19:27:07.597242 (+ 525us) log.cc:842] Serialized 23 byte log entry
0812 19:27:07.598510 (+ 1268us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.598648 (+ 138us) write_op.cc:454] Released schema lock
0812 19:27:07.598702 (+ 54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"child_traces":[["op",{"apply.queue_time_us":161,"num_ops":1,"prepare.queue_time_us":139392,"prepare.run_cpu_time_us":4133,"prepare.run_wall_time_us":96343,"raft.queue_time_us":69654,"raft.run_cpu_time_us":11,"raft.run_wall_time_us":11,"replication_time_us":172188}]]}
I20260812 19:27:07.645763 7958 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_a059cc3e3a9345ddbd2e7c031966470f"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:07.647799 7958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_a059cc3e3a9345ddbd2e7c031966470f in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:07.657809 9444 consensus_queue.cc:1035] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:07.665656 8623 tablet_bootstrap.cc:492] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:07.666733 9483 tablet_replica.cc:330] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:27:07.693455 8443 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 7d660422701a423794416b01cea825b4
I20260812 19:27:07.694221 8443 leader_election.cc:302] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:07.695487 9282 raft_consensus.cc:2726] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:07.705192 7948 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet fac74fcb73d1489f8542496293d6141c (table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fac74fcb73d1489f8542496293d6141c has no consensus state
I20260812 19:27:07.631556 9482 tablet_replica.cc:330] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:07.742928 9482 raft_consensus.cc:2229] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:07.753329 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_04cd3cfca142418d9027f11abd45ccee"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:07.755172 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_04cd3cfca142418d9027f11abd45ccee in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:27:07.765771 9521 log.cc:924] Time spent T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.297s user 0.000s sys 0.001s
I20260812 19:27:07.771701 7953 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_b25383bb16404fac95cc1d79e20e1185"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:07.773505 7953 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b25383bb16404fac95cc1d79e20e1185 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:07.777449 9445 raft_consensus.cc:482] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.778280 9445 raft_consensus.cc:504] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.784384 9445 leader_election.cc:288] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:07.783924 8636 tablet_bootstrap.cc:492] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:07.785202 8636 ts_tablet_manager.cc:1397] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.335s user 0.012s sys 0.007s
I20260812 19:27:07.786700 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df369d3c4e004c29ac65c5ecf7f8c4cc" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:07.788646 8278 leader_election.cc:341] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:07.792970 9483 raft_consensus.cc:2229] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:07.803333 9483 raft_consensus.cc:2258] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:07.805269 9482 raft_consensus.cc:2258] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:07.805716 8281 leader_election.cc:341] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc
I20260812 19:27:07.806095 8281 leader_election.cc:302] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:07.806641 9483 ts_tablet_manager.cc:1905] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:07.806892 8623 tablet_bootstrap.cc:654] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.807240 9171 raft_consensus.cc:2726] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:07.810326 8569 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:27:07.810530 8636 raft_consensus.cc:348] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.811314 8636 raft_consensus.cc:374] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.811846 8410 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:27:07.831595 8636 raft_consensus.cc:729] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.834214 8409 heartbeater.cc:347] Connected to a master server at 127.7.144.252:46815
I20260812 19:27:07.828312 8627 tablet_bootstrap.cc:654] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.841945 8636 consensus_queue.cc:260] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.843231 8243 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:27:07.871415 9482 ts_tablet_manager.cc:1905] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:07.880509 8636 ts_tablet_manager.cc:1428] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.095s user 0.003s sys 0.006s
I20260812 19:27:07.885056 8636 tablet_bootstrap.cc:492] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:07.894124 8627 tablet_bootstrap.cc:492] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:07.894594 8627 ts_tablet_manager.cc:1397] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.446s user 0.007s sys 0.012s
I20260812 19:27:07.902304 8627 raft_consensus.cc:348] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.902997 8627 raft_consensus.cc:374] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.903258 8627 raft_consensus.cc:729] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.904107 8627 consensus_queue.cc:260] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.918704 8623 tablet_bootstrap.cc:492] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:07.919135 8623 ts_tablet_manager.cc:1397] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.254s user 0.008s sys 0.010s
I20260812 19:27:07.922070 7954 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_c0342c9c603b4c74983e00d14709ee8b" } new_table_name: "default.Table_c1665280164645aeaa0ada50bf7e6629" modify_external_catalogs: true
I20260812 19:27:07.922289 8623 raft_consensus.cc:348] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:07.922986 8623 raft_consensus.cc:374] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:07.923224 8623 raft_consensus.cc:729] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:07.923748 8623 consensus_queue.cc:260] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:07.928051 8636 tablet_bootstrap.cc:654] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:07.942601 8627 ts_tablet_manager.cc:1428] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.048s user 0.007s sys 0.000s
I20260812 19:27:07.957716 9282 raft_consensus.cc:482] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.958432 9282 raft_consensus.cc:504] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:07.961974 9282 leader_election.cc:288] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:07.964447 9445 raft_consensus.cc:482] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:07.965139 9445 raft_consensus.cc:504] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:07.966894 8443 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:07.969497 9445 leader_election.cc:288] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:07.970834 8623 ts_tablet_manager.cc:1428] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.051s user 0.002s sys 0.006s
I20260812 19:27:07.971446 8627 tablet_bootstrap.cc:492] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:07.992571 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:07.994441 8278 leader_election.cc:341] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:08.012414 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:08.015179 8446 leader_election.cc:302] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:08.016494 9282 raft_consensus.cc:2726] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:08.025928 8278 consensus_peers.cc:487] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:08.015945 9483 ts_tablet_manager.cc:1918] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:08.047305 8623 tablet_bootstrap.cc:492] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:08.046568 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:08.048321 8178 raft_consensus.cc:2454] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:08.058832 8281 leader_election.cc:302] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:08.059993 8623 tablet_bootstrap.cc:654] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.045904 8627 tablet_bootstrap.cc:654] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.057300 9483 log.cc:1196] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:08.075515 9483 ts_tablet_manager.cc:1939] T 3740799e07f94fe981d395ef8c3d7973 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:08.039697 9526 sys_catalog.cc:263] Verifying existing consensus state
I20260812 19:27:08.089622 9444 raft_consensus.cc:2781] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:08.090325 9444 raft_consensus.cc:482] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:08.090721 9444 raft_consensus.cc:3037] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:08.095570 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 3740799e07f94fe981d395ef8c3d7973 (table default.Table_a4bcfc2b1f29474b8e3fcc3707d318b7 [id=044415e437a041018393bc64b1496166]) successfully deleted
W20260812 19:27:08.111598 7946 catalog_manager.cc:4808] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 because the tablet was not found. No further retry: Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:08.112915 9483 tablet_replica.cc:330] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:08.114245 9483 raft_consensus.cc:2229] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:08.115613 9483 raft_consensus.cc:2258] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:08.119163 9483 ts_tablet_manager.cc:1905] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:08.131639 8515 raft_consensus.cc:3037] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:08.134114 9444 raft_consensus.cc:504] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.136583 9445 consensus_queue.cc:1035] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:08.138851 9451 raft_consensus.cc:482] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.143162 9451 raft_consensus.cc:504] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.145134 9451 leader_election.cc:288] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:08.146565 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:08.148283 8278 leader_election.cc:341] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:08.150418 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:08.151913 9444 leader_election.cc:288] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:08.152284 8278 leader_election.cc:341] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:08.160137 7960 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8d4ff5105fa143a5ae773476d55deed3"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:08.161672 7960 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8d4ff5105fa143a5ae773476d55deed3 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:08.168596 9469 raft_consensus.cc:482] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:08.169377 9469 raft_consensus.cc:504] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.170428 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:08.171011 8636 tablet_bootstrap.cc:492] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:08.171113 8180 raft_consensus.cc:3037] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:08.171705 8636 ts_tablet_manager.cc:1397] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.287s user 0.053s sys 0.115s
I20260812 19:27:08.173884 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:08.174814 9469 leader_election.cc:288] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:08.174757 8510 raft_consensus.cc:2454] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:08.176820 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:08.177448 8108 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:08.177670 8179 raft_consensus.cc:2454] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:08.179247 8281 leader_election.cc:302] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:08.180649 8107 leader_election.cc:302] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:08.182830 8627 tablet_bootstrap.cc:492] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:08.184489 9469 raft_consensus.cc:2781] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:08.184980 9469 raft_consensus.cc:482] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:08.175180 8636 raft_consensus.cc:348] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.185562 8636 raft_consensus.cc:374] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.185472 9469 raft_consensus.cc:3037] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:08.185864 8636 raft_consensus.cc:729] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.188917 8636 consensus_queue.cc:260] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.193651 8627 ts_tablet_manager.cc:1397] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.230s user 0.013s sys 0.008s
I20260812 19:27:08.198125 9444 raft_consensus.cc:2781] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:08.198956 9444 raft_consensus.cc:482] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:08.199575 9444 raft_consensus.cc:3037] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:08.206532 8627 raft_consensus.cc:348] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.207387 8627 raft_consensus.cc:374] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.207635 8627 raft_consensus.cc:729] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.208907 8636 ts_tablet_manager.cc:1428] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.037s user 0.007s sys 0.000s
I20260812 19:27:08.225411 8636 tablet_bootstrap.cc:492] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:08.231451 8627 consensus_queue.cc:260] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.236915 9526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Bootstrap starting.
I20260812 19:27:08.239898 8627 ts_tablet_manager.cc:1428] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.046s user 0.006s sys 0.002s
I20260812 19:27:08.241127 8627 tablet_bootstrap.cc:492] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:08.246515 7755 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerService.ListTablets -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 66705.7us
I20260812 19:27:08.247413 8636 tablet_bootstrap.cc:654] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.250175 9483 ts_tablet_manager.cc:1918] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:08.253479 9483 log.cc:1196] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/a49e46c8ba704680bf12423854883b55
I20260812 19:27:08.255132 9483 ts_tablet_manager.cc:1939] T a49e46c8ba704680bf12423854883b55 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:08.260483 9255 raft_consensus.cc:482] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.261068 9255 raft_consensus.cc:504] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.262970 9483 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 228) took 1072 ms. Trace:
I20260812 19:27:08.263036 9469 raft_consensus.cc:504] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.265461 9255 leader_election.cc:288] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:08.265565 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:08.267072 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:08.263402 9483 rpcz_store.cc:276] 0812 19:27:07.200074 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.238446 (+ 38372us) service_pool.cc:227] Handling call
0812 19:27:08.112565 (+874119us) ts_tablet_manager.cc:1145] Deleting tablet a49e46c8ba704680bf12423854883b55
0812 19:27:08.112625 (+ 60us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:08.183405 (+ 70780us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:08.240057 (+ 56652us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:08.262882 (+ 22825us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":849300}
I20260812 19:27:08.268872 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet a49e46c8ba704680bf12423854883b55 (table default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]) successfully deleted
W20260812 19:27:08.268600 8107 leader_election.cc:341] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:08.269814 8108 leader_election.cc:341] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:08.270217 8108 leader_election.cc:302] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:08.271041 9535 raft_consensus.cc:2726] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:08.271757 8636 tablet_bootstrap.cc:492] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:08.272161 8636 ts_tablet_manager.cc:1397] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.047s user 0.010s sys 0.004s
I20260812 19:27:08.276070 8636 raft_consensus.cc:348] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.276774 8636 raft_consensus.cc:374] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.277024 8636 raft_consensus.cc:729] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.277908 9469 leader_election.cc:288] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:08.277669 8636 consensus_queue.cc:260] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.278649 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc5c4ef0441c49fca31b2fc8a2c9abd4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:08.279130 8410 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:27:08.279223 8510 raft_consensus.cc:3037] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 2
W20260812 19:27:08.287007 8108 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:08.294585 8636 ts_tablet_manager.cc:1428] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.022s user 0.006s sys 0.000s
I20260812 19:27:08.306411 8636 tablet_bootstrap.cc:492] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:08.323163 8180 raft_consensus.cc:2454] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:08.324810 8281 leader_election.cc:302] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:08.325624 9171 raft_consensus.cc:2781] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:08.326056 9171 raft_consensus.cc:686] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:08.327054 8636 tablet_bootstrap.cc:654] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.326851 9171 consensus_queue.cc:237] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.334282 8510 raft_consensus.cc:2454] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 2.
I20260812 19:27:08.342707 9282 raft_consensus.cc:482] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.343338 9282 raft_consensus.cc:504] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.346554 9282 leader_election.cc:288] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:08.351377 8107 leader_election.cc:302] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:08.354375 8627 tablet_bootstrap.cc:654] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.355618 8636 tablet_bootstrap.cc:492] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:08.356395 8636 ts_tablet_manager.cc:1397] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.050s user 0.014s sys 0.004s
W20260812 19:27:08.357534 8443 leader_election.cc:341] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a84bf28a3e174f3b88f8758b09ced1f1
I20260812 19:27:08.355871 9255 raft_consensus.cc:2781] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:08.359130 9255 raft_consensus.cc:686] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:08.361004 9255 consensus_queue.cc:237] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.361330 8636 raft_consensus.cc:348] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.362005 8636 raft_consensus.cc:374] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.362599 8636 raft_consensus.cc:729] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.372748 8636 consensus_queue.cc:260] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:08.374624 8278 consensus_peers.cc:487] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:08.375057 8636 ts_tablet_manager.cc:1428] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.018s user 0.004s sys 0.003s
I20260812 19:27:08.354550 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:08.375913 8636 tablet_bootstrap.cc:492] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:08.379869 8623 tablet_bootstrap.cc:492] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:08.380383 8623 ts_tablet_manager.cc:1397] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.333s user 0.010s sys 0.007s
I20260812 19:27:08.372191 9526 log.cc:824] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Log is configured to *not* fsync() on all Append() calls
I20260812 19:27:08.382829 8623 raft_consensus.cc:348] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.383724 8623 raft_consensus.cc:374] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.390208 8636 tablet_bootstrap.cc:654] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.402242 8636 tablet_bootstrap.cc:492] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:08.402654 8636 ts_tablet_manager.cc:1397] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.001s
I20260812 19:27:08.388062 9444 raft_consensus.cc:504] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.409474 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:08.410260 8178 raft_consensus.cc:3037] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:08.419056 8333 tablet_service.cc:1467] Processing CreateTablet for tablet 841c459584534458977b6182b71c77f1 (DEFAULT_TABLE table=default.Table_bbda5db214af4795b1d794c0bfa3b278 [id=c8606c010ad14f069ef54b863a2010e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.420109 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 841c459584534458977b6182b71c77f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.422921 8330 tablet_service.cc:1467] Processing CreateTablet for tablet fac74fcb73d1489f8542496293d6141c (DEFAULT_TABLE table=default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.424044 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fac74fcb73d1489f8542496293d6141c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.424666 7952 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:08.426960 8627 tablet_bootstrap.cc:492] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:08.427362 8627 ts_tablet_manager.cc:1397] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.186s user 0.002s sys 0.011s
I20260812 19:27:08.405889 8636 raft_consensus.cc:348] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.434577 8636 raft_consensus.cc:374] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.434237 8481 tablet_service.cc:1467] Processing CreateTablet for tablet 841c459584534458977b6182b71c77f1 (DEFAULT_TABLE table=default.Table_bbda5db214af4795b1d794c0bfa3b278 [id=c8606c010ad14f069ef54b863a2010e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.434927 8636 raft_consensus.cc:729] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.436004 8481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 841c459584534458977b6182b71c77f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.440559 8636 consensus_queue.cc:260] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.441417 8492 tablet_service.cc:1467] Processing CreateTablet for tablet fac74fcb73d1489f8542496293d6141c (DEFAULT_TABLE table=default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.441443 8322 tablet_service.cc:1467] Processing CreateTablet for tablet b51a28468ba74a8e88d0936dc3281eca (DEFAULT_TABLE table=default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.442600 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fac74fcb73d1489f8542496293d6141c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.443084 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b51a28468ba74a8e88d0936dc3281eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.443987 8636 ts_tablet_manager.cc:1428] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.041s user 0.006s sys 0.001s
I20260812 19:27:08.445201 8636 tablet_bootstrap.cc:492] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:08.445086 9444 leader_election.cc:288] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:08.452106 7952 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:08.453267 7952 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 2 got 0
I20260812 19:27:08.454931 8627 raft_consensus.cc:348] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:08.458276 8627 raft_consensus.cc:374] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.458556 8627 raft_consensus.cc:729] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.465397 8323 tablet_service.cc:1467] Processing CreateTablet for tablet 9b5e92063f494c79be75371f2626b1e3 (DEFAULT_TABLE table=default.Table_4b45622c6d97488f977a6ef6b04ac74e [id=c625aebe1cfc488cb159c2796db94108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.466849 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b5e92063f494c79be75371f2626b1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.467522 8627 consensus_queue.cc:260] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:08.469825 8180 raft_consensus.cc:2379] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:08.476981 8488 tablet_service.cc:1467] Processing CreateTablet for tablet b51a28468ba74a8e88d0936dc3281eca (DEFAULT_TABLE table=default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.477311 8148 tablet_service.cc:1467] Processing CreateTablet for tablet 841c459584534458977b6182b71c77f1 (DEFAULT_TABLE table=default.Table_bbda5db214af4795b1d794c0bfa3b278 [id=c8606c010ad14f069ef54b863a2010e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.477671 8514 raft_consensus.cc:3037] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:08.478202 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b51a28468ba74a8e88d0936dc3281eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.478694 8148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 841c459584534458977b6182b71c77f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.483593 8333 tablet_service.cc:1467] Processing CreateTablet for tablet e0a53a91dc9e41d58ee4f6a083ca204c (DEFAULT_TABLE table=default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.489827 8491 tablet_service.cc:1467] Processing CreateTablet for tablet e0a53a91dc9e41d58ee4f6a083ca204c (DEFAULT_TABLE table=default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.490994 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0a53a91dc9e41d58ee4f6a083ca204c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.491808 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0a53a91dc9e41d58ee4f6a083ca204c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.512363 9171 raft_consensus.cc:482] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.513149 9171 raft_consensus.cc:504] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.518074 9171 leader_election.cc:288] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:08.518643 8484 tablet_service.cc:1467] Processing CreateTablet for tablet 9b5e92063f494c79be75371f2626b1e3 (DEFAULT_TABLE table=default.Table_4b45622c6d97488f977a6ef6b04ac74e [id=c625aebe1cfc488cb159c2796db94108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.520646 9551 raft_consensus.cc:482] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.384016 8623 raft_consensus.cc:729] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.521421 9551 raft_consensus.cc:504] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.523980 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:08.527117 8636 tablet_bootstrap.cc:654] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:08.527647 8278 leader_election.cc:341] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:08.529912 8443 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 863e7ca808f54a989b3372aa4bfe361e
I20260812 19:27:08.530670 9551 leader_election.cc:288] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:08.520172 8484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b5e92063f494c79be75371f2626b1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.542049 8627 ts_tablet_manager.cc:1428] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.106s user 0.004s sys 0.003s
I20260812 19:27:08.544697 8623 consensus_queue.cc:260] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.547364 8627 tablet_bootstrap.cc:492] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:08.555930 8330 tablet_service.cc:1467] Processing CreateTablet for tablet c67135f8c5ae422485bca11ada90afaa (DEFAULT_TABLE table=default.Table_d919a6bee2304ccab308b3d08e5be52c [id=82b4d20f40ab43c990959b458f3b11e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.560846 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c67135f8c5ae422485bca11ada90afaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:08.572997 7954 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 9bdb7cce923c4ed98e400c121b6237ba consensus state has no leader
I20260812 19:27:08.571528 7958 catalog_manager.cc:5495] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:08.574402 7954 master_service.cc:946] ReplaceTablet: received request to replace tablet 613763d1b3074766bee2d026de516065 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:08.585192 7958 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:08.545572 8512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:08.591315 8623 ts_tablet_manager.cc:1428] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.211s user 0.006s sys 0.000s
W20260812 19:27:08.597018 8278 leader_election.cc:341] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:08.596827 8479 tablet_service.cc:1467] Processing CreateTablet for tablet c67135f8c5ae422485bca11ada90afaa (DEFAULT_TABLE table=default.Table_d919a6bee2304ccab308b3d08e5be52c [id=82b4d20f40ab43c990959b458f3b11e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.598277 8479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c67135f8c5ae422485bca11ada90afaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.599843 8178 raft_consensus.cc:2454] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:08.602828 8636 tablet_bootstrap.cc:492] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:08.602617 8627 tablet_bootstrap.cc:654] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.603243 8636 ts_tablet_manager.cc:1397] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.158s user 0.012s sys 0.010s
I20260812 19:27:08.604630 8623 tablet_bootstrap.cc:492] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:08.631208 8446 leader_election.cc:302] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:08.634912 8636 raft_consensus.cc:348] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.635051 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "863e7ca808f54a989b3372aa4bfe361e" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:08.635673 8636 raft_consensus.cc:374] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.636499 9551 raft_consensus.cc:3037] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:08.640996 8278 consensus_peers.cc:487] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:08.642740 8323 tablet_service.cc:1467] Processing CreateTablet for tablet c607886a76344185aa9af5da797b9ae8 (DEFAULT_TABLE table=default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.635960 8636 raft_consensus.cc:729] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.644182 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c607886a76344185aa9af5da797b9ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.644817 8636 consensus_queue.cc:260] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.645970 7958 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:08.646831 7958 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet f7c9e6328b70417cbeecf31f318f9b61 (table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]). Expected version 1 got 0
I20260812 19:27:08.647570 8636 ts_tablet_manager.cc:1428] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.044s user 0.006s sys 0.001s
I20260812 19:27:08.648607 8636 tablet_bootstrap.cc:492] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:08.655265 9551 raft_consensus.cc:2726] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:08.655293 8151 tablet_service.cc:1467] Processing CreateTablet for tablet fac74fcb73d1489f8542496293d6141c (DEFAULT_TABLE table=default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.657321 8151 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fac74fcb73d1489f8542496293d6141c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.668648 8627 tablet_bootstrap.cc:492] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:08.669162 8627 ts_tablet_manager.cc:1397] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.122s user 0.024s sys 0.006s
I20260812 19:27:08.669951 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:08.672144 8178 raft_consensus.cc:2454] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:08.672857 9171 consensus_queue.cc:1035] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:08.673080 8627 raft_consensus.cc:348] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.674561 8627 raft_consensus.cc:374] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.675136 8627 raft_consensus.cc:729] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.675426 9526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:27:08.676910 9526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Bootstrap complete.
I20260812 19:27:08.676385 8627 consensus_queue.cc:260] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.678668 9482 ts_tablet_manager.cc:1918] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:08.679263 9482 log.cc:1196] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/863e7ca808f54a989b3372aa4bfe361e
I20260812 19:27:08.680212 9482 ts_tablet_manager.cc:1939] T 863e7ca808f54a989b3372aa4bfe361e P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:08.683154 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 264) took 1812 ms. Trace:
I20260812 19:27:08.691915 8627 ts_tablet_manager.cc:1428] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.022s user 0.010s sys 0.000s
I20260812 19:27:08.695082 9282 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.698627 8627 tablet_bootstrap.cc:492] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:08.704726 8281 leader_election.cc:302] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:08.706219 8281 leader_election.cc:302] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:08.707237 9444 raft_consensus.cc:2781] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:08.707803 9444 raft_consensus.cc:686] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:08.695653 9282 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.709004 9444 consensus_queue.cc:237] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.711338 9282 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:08.712554 9445 raft_consensus.cc:2781] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:08.713106 9445 raft_consensus.cc:482] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:08.713716 9445 raft_consensus.cc:3037] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:08.720844 8636 tablet_bootstrap.cc:654] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.735073 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:08.737483 9282 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.738188 9282 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.752698 8488 tablet_service.cc:1467] Processing CreateTablet for tablet c607886a76344185aa9af5da797b9ae8 (DEFAULT_TABLE table=default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.752782 9282 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:08.754273 8443 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:08.754519 8491 tablet_service.cc:1467] Processing CreateTablet for tablet 663d0d16b9cd4bed9bb5529b514f9e30 (DEFAULT_TABLE table=default.Table_f4fba6ed708046e48420257d6693f0c3 [id=8963896ef496485ba2eff5e329a70150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.757751 8327 tablet_service.cc:1467] Processing CreateTablet for tablet 663d0d16b9cd4bed9bb5529b514f9e30 (DEFAULT_TABLE table=default.Table_f4fba6ed708046e48420257d6693f0c3 [id=8963896ef496485ba2eff5e329a70150]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.758917 8327 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 663d0d16b9cd4bed9bb5529b514f9e30. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:08.771522 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 9bdb7cce923c4ed98e400c121b6237ba (table default.Table_c1665280164645aeaa0ada50bf7e6629 [id=ea7ebd72106345978b7ccd28e8599c2b], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 9bdb7cce923c4ed98e400c121b6237ba consensus state has no leader
W20260812 19:27:08.779956 8446 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: Tablet not RUNNING: STOPPED
I20260812 19:27:08.786486 8446 leader_election.cc:302] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:08.787168 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c607886a76344185aa9af5da797b9ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.788924 9282 raft_consensus.cc:2726] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:08.791493 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 663d0d16b9cd4bed9bb5529b514f9e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:08.799835 8636 tablet_bootstrap.cc:492] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:08.800237 8636 ts_tablet_manager.cc:1397] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.152s user 0.014s sys 0.003s
I20260812 19:27:08.833499 8636 raft_consensus.cc:348] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.834214 8636 raft_consensus.cc:374] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:08.834477 8636 raft_consensus.cc:729] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:08.835570 8627 tablet_bootstrap.cc:654] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.835172 8636 consensus_queue.cc:260] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.821321 9445 raft_consensus.cc:504] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:08.839287 9445 leader_election.cc:288] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:08.840592 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:08.841089 9449 raft_consensus.cc:482] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.841514 9449 raft_consensus.cc:504] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:08.841915 8278 leader_election.cc:341] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:08.842511 9482 rpcz_store.cc:276] 0812 19:27:06.870558 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.870735 (+ 177us) service_pool.cc:227] Handling call
0812 19:27:07.631287 (+760552us) ts_tablet_manager.cc:1145] Deleting tablet 863e7ca808f54a989b3372aa4bfe361e
0812 19:27:07.631354 (+ 67us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:08.126091 (+494737us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:08.678288 (+552197us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:08.683087 (+ 4799us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2230,"tablet-delete.queue_time_us":759931}
I20260812 19:27:08.843487 9449 leader_election.cc:288] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:08.844244 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 863e7ca808f54a989b3372aa4bfe361e (table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]) successfully deleted
I20260812 19:27:08.845162 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6075b2e46524829962d2b84353013b2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:08.846585 8278 leader_election.cc:341] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:08.849665 8636 ts_tablet_manager.cc:1428] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.049s user 0.004s sys 0.001s
I20260812 19:27:08.851063 8636 tablet_bootstrap.cc:492] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:08.851990 9255 raft_consensus.cc:482] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.852591 9255 raft_consensus.cc:504] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:08.853030 9572 tablet.cc:1722] T 96839764810f4b7e9b3dd7a64be85dd1 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:08.855479 9255 leader_election.cc:288] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:08.869225 9573 tablet.cc:1722] T 96839764810f4b7e9b3dd7a64be85dd1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:08.687127 8623 tablet_bootstrap.cc:654] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.688405 8158 tablet_service.cc:1467] Processing CreateTablet for tablet b51a28468ba74a8e88d0936dc3281eca (DEFAULT_TABLE table=default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.689813 8154 tablet_service.cc:1467] Processing CreateTablet for tablet e0a53a91dc9e41d58ee4f6a083ca204c (DEFAULT_TABLE table=default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.935021 8636 tablet_bootstrap.cc:654] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:08.691327 8157 tablet_service.cc:1467] Processing CreateTablet for tablet 9b5e92063f494c79be75371f2626b1e3 (DEFAULT_TABLE table=default.Table_4b45622c6d97488f977a6ef6b04ac74e [id=c625aebe1cfc488cb159c2796db94108]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.692755 8152 tablet_service.cc:1467] Processing CreateTablet for tablet c67135f8c5ae422485bca11ada90afaa (DEFAULT_TABLE table=default.Table_d919a6bee2304ccab308b3d08e5be52c [id=82b4d20f40ab43c990959b458f3b11e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.784731 8156 tablet_service.cc:1467] Processing CreateTablet for tablet c607886a76344185aa9af5da797b9ae8 (DEFAULT_TABLE table=default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:08.939968 9444 consensus_queue.cc:1035] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260812 19:27:08.960959 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:08.970202 8627 tablet_bootstrap.cc:492] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:08.978565 9282 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:08.979071 9282 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:08.984719 8443 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:08.983136 9282 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:08.998566 8627 ts_tablet_manager.cc:1397] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.302s user 0.004s sys 0.012s
I20260812 19:27:08.995764 8330 tablet_service.cc:1467] Processing CreateTablet for tablet 6b32b8e857c04567a2a751c379a05440 (DEFAULT_TABLE table=default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.004004 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b32b8e857c04567a2a751c379a05440. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:09.010736 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 78541.1us
I20260812 19:27:09.018803 8636 tablet_bootstrap.cc:492] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:09.019349 8636 ts_tablet_manager.cc:1397] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.168s user 0.009s sys 0.016s
I20260812 19:27:09.025758 8636 raft_consensus.cc:348] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.015590 8155 tablet_service.cc:1467] Processing CreateTablet for tablet 663d0d16b9cd4bed9bb5529b514f9e30 (DEFAULT_TABLE table=default.Table_f4fba6ed708046e48420257d6693f0c3 [id=8963896ef496485ba2eff5e329a70150]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:27:09.013836 8107 leader_election.cc:341] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:09.031462 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 47216us
I20260812 19:27:09.033699 8147 tablet_service.cc:1467] Processing CreateTablet for tablet 6b32b8e857c04567a2a751c379a05440 (DEFAULT_TABLE table=default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.037840 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:09.038865 8182 raft_consensus.cc:3037] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:09.041055 8322 consensus_meta.cc:287] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7: Time spent flushing consensus metadata: real 0.515s user 0.004s sys 0.004s
I20260812 19:27:09.041823 8333 tablet_service.cc:1467] Processing CreateTablet for tablet fbff8d38116d4af9ba9497f65e876827 (DEFAULT_TABLE table=default.Table_916f8c0b79394ffc9e296b898a1f93ec [id=9d6691884d174daba49818fe5d1529ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.042503 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bce01fd81f04f23a8cddc3a7b5eae8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:09.043499 8179 raft_consensus.cc:2379] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:09.021168 9526 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:09.038725 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 6b32b8e857c04567a2a751c379a05440 (DEFAULT_TABLE table=default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.048388 8636 raft_consensus.cc:374] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.048651 8636 raft_consensus.cc:729] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.048964 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b32b8e857c04567a2a751c379a05440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.049274 8636 consensus_queue.cc:260] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.002391 8627 raft_consensus.cc:348] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.051644 8627 raft_consensus.cc:374] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.051891 8627 raft_consensus.cc:729] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.040391 8491 tablet_service.cc:1467] Processing CreateTablet for tablet fbff8d38116d4af9ba9497f65e876827 (DEFAULT_TABLE table=default.Table_916f8c0b79394ffc9e296b898a1f93ec [id=9d6691884d174daba49818fe5d1529ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.042325 8481 tablet_service.cc:1467] Processing CreateTablet for tablet 140266bae6254efe9b87d0f8e3bfaa4e (DEFAULT_TABLE table=default.Table_51762252a63548a9bf108b1eed133662 [id=af0b194d7f274839bc613a16526ce7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.052474 8627 consensus_queue.cc:260] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.054768 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbff8d38116d4af9ba9497f65e876827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.055370 8481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 140266bae6254efe9b87d0f8e3bfaa4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.064554 8636 ts_tablet_manager.cc:1428] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.045s user 0.003s sys 0.004s
I20260812 19:27:09.065608 8636 tablet_bootstrap.cc:492] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:09.075485 8492 tablet_service.cc:1467] Processing CreateTablet for tablet f6f3a2193f2744249de635be4f949889 (DEFAULT_TABLE table=default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 [id=74a2d08bc0c84a5588100bf04f828cf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.076536 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6f3a2193f2744249de635be4f949889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.079138 8328 tablet_service.cc:1467] Processing CreateTablet for tablet f6f3a2193f2744249de635be4f949889 (DEFAULT_TABLE table=default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 [id=74a2d08bc0c84a5588100bf04f828cf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.079306 8627 ts_tablet_manager.cc:1428] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.080s user 0.003s sys 0.003s
I20260812 19:27:09.082412 8322 tablet_service.cc:1467] Processing CreateTablet for tablet 140266bae6254efe9b87d0f8e3bfaa4e (DEFAULT_TABLE table=default.Table_51762252a63548a9bf108b1eed133662 [id=af0b194d7f274839bc613a16526ce7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.090374 8332 tablet_service.cc:1467] Processing CreateTablet for tablet 7b689d49a1244c7fb12ba84853f2da9d (DEFAULT_TABLE table=default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.080647 9526 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e9a660a0f1e4fc6bc6335b38eece0bd, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.029290 9482 tablet_replica.cc:330] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:09.101842 9482 raft_consensus.cc:2229] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:09.110319 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6b32b8e857c04567a2a751c379a05440. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.100899 9526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:09.112967 8156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c607886a76344185aa9af5da797b9ae8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.116863 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e0a53a91dc9e41d58ee4f6a083ca204c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.119361 8155 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 663d0d16b9cd4bed9bb5529b514f9e30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.120021 8158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b51a28468ba74a8e88d0936dc3281eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.120687 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c67135f8c5ae422485bca11ada90afaa. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:09.134003 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 101754us
I20260812 19:27:09.136581 8157 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b5e92063f494c79be75371f2626b1e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.143504 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:09.128980 8484 tablet_service.cc:1467] Processing CreateTablet for tablet 7b689d49a1244c7fb12ba84853f2da9d (DEFAULT_TABLE table=default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.148948 8484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b689d49a1244c7fb12ba84853f2da9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.150204 8636 tablet_bootstrap.cc:654] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:09.178611 9579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:09.192072 9579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:09.197423 9482 raft_consensus.cc:2258] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:09.197918 8153 tablet_service.cc:1467] Processing CreateTablet for tablet 140266bae6254efe9b87d0f8e3bfaa4e (DEFAULT_TABLE table=default.Table_51762252a63548a9bf108b1eed133662 [id=af0b194d7f274839bc613a16526ce7a3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.196918 8636 tablet_bootstrap.cc:492] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:09.200067 8636 ts_tablet_manager.cc:1397] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.135s user 0.003s sys 0.011s
I20260812 19:27:09.201201 8145 tablet_service.cc:1467] Processing CreateTablet for tablet 7b689d49a1244c7fb12ba84853f2da9d (DEFAULT_TABLE table=default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.209208 9526 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:27:09.210711 8636 raft_consensus.cc:348] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.215333 8636 raft_consensus.cc:374] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.216008 8636 raft_consensus.cc:729] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.217068 8636 consensus_queue.cc:260] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.225756 8146 tablet_service.cc:1467] Processing CreateTablet for tablet f6f3a2193f2744249de635be4f949889 (DEFAULT_TABLE table=default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 [id=74a2d08bc0c84a5588100bf04f828cf2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:09.229072 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6075b2e46524829962d2b84353013b2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:09.229996 8177 raft_consensus.cc:2454] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:09.231767 8636 ts_tablet_manager.cc:1428] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.031s user 0.004s sys 0.003s
W20260812 19:27:09.233307 8108 leader_election.cc:341] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:09.233681 8108 leader_election.cc:302] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:09.238236 8446 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:09.238957 9282 raft_consensus.cc:3037] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:09.158236 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:09.251223 8514 raft_consensus.cc:3037] T 6aa599b75d9e4f10b2cbed69b9b9c92b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:09.257120 9469 raft_consensus.cc:2726] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:09.256131 9282 raft_consensus.cc:2726] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:09.238608 8636 tablet_bootstrap.cc:492] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:09.263506 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6f3a2193f2744249de635be4f949889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.263718 8627 tablet_bootstrap.cc:492] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:09.265434 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbff8d38116d4af9ba9497f65e876827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.266004 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b689d49a1244c7fb12ba84853f2da9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.277194 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 140266bae6254efe9b87d0f8e3bfaa4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.278759 8627 tablet_bootstrap.cc:654] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:09.256999 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:09.202906 8145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b689d49a1244c7fb12ba84853f2da9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.293561 9444 raft_consensus.cc:482] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:09.294365 9444 raft_consensus.cc:504] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.301141 9444 leader_election.cc:288] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:09.303215 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:09.305825 8278 leader_election.cc:341] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:09.204087 8149 tablet_service.cc:1467] Processing CreateTablet for tablet fbff8d38116d4af9ba9497f65e876827 (DEFAULT_TABLE table=default.Table_916f8c0b79394ffc9e296b898a1f93ec [id=9d6691884d174daba49818fe5d1529ac]), partition=RANGE (key) PARTITION UNBOUNDED
W20260812 19:27:09.310045 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 68815.7us
W20260812 19:27:09.327405 8278 consensus_peers.cc:487] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:09.335546 8149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbff8d38116d4af9ba9497f65e876827. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.338608 8146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f6f3a2193f2744249de635be4f949889. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:09.339260 8446 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:09.340484 9282 raft_consensus.cc:2726] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:09.347330 8153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 140266bae6254efe9b87d0f8e3bfaa4e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:09.348012 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 86578.7us
I20260812 19:27:09.369937 9561 raft_consensus.cc:482] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:09.370795 9561 raft_consensus.cc:504] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.373965 9561 leader_election.cc:288] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:09.377585 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:09.378968 8636 tablet_bootstrap.cc:654] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:09.391491 8108 leader_election.cc:341] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:09.381211 8627 tablet_bootstrap.cc:492] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:09.392194 8627 ts_tablet_manager.cc:1397] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.129s user 0.007s sys 0.021s
I20260812 19:27:09.409094 8627 raft_consensus.cc:348] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.420393 8627 raft_consensus.cc:374] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.421662 8627 raft_consensus.cc:729] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.425480 8627 consensus_queue.cc:260] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.428987 8627 ts_tablet_manager.cc:1428] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.036s user 0.009s sys 0.000s
I20260812 19:27:09.434854 8627 tablet_bootstrap.cc:492] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:09.449693 8627 tablet_bootstrap.cc:654] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:09.462984 8446 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:09.464038 9282 raft_consensus.cc:2726] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:09.480090 9445 raft_consensus.cc:482] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:09.480631 9445 raft_consensus.cc:504] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.483312 9445 leader_election.cc:288] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:09.487528 7954 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 613763d1b3074766bee2d026de516065
I20260812 19:27:09.488873 7954 catalog_manager.cc:6565] ReplaceTablet: tablet 613763d1b3074766bee2d026de516065 deleted and replaced by tablet cdb6ba8b98474fff97ae3f45218870f0
I20260812 19:27:09.489210 7954 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:46888 (request call id 271) took 1357 ms. Trace:
I20260812 19:27:09.489461 7954 rpcz_store.cc:276] 0812 19:27:08.131801 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.574176 (+442375us) service_pool.cc:227] Handling call
0812 19:27:08.614582 (+ 40406us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eb1b81 00007f05eea0cd37 00007f05eea0ccc2 00007f05eea0cbf1 00007f05eea0cb6c 00007f05eea0be22 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:09.489139 (+874557us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:09.470698 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:09.471261 (+ 563us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:09.471298 (+ 37us) write_op.cc:435] Acquired schema lock
0812 19:27:09.471323 (+ 25us) tablet.cc:660] Decoding operations
0812 19:27:09.471761 (+ 438us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:09.471824 (+ 63us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:09.471860 (+ 36us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:09.472146 (+ 286us) tablet.cc:699] Row locks acquired
0812 19:27:09.472176 (+ 30us) write_op.cc:260] PREPARE: finished
0812 19:27:09.472344 (+ 168us) write_op.cc:270] Start()
0812 19:27:09.472462 (+ 118us) write_op.cc:276] Timestamp: P: 1786562829472257 usec, L: 0
0812 19:27:09.472488 (+ 26us) op_driver.cc:331] REPLICATION: starting
0812 19:27:09.473199 (+ 711us) log.cc:842] Serialized 628 byte log entry
0812 19:27:09.484650 (+ 11451us) op_driver.cc:444] REPLICATION: finished
0812 19:27:09.485081 (+ 431us) write_op.cc:301] APPLY: starting
0812 19:27:09.485166 (+ 85us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:09.485312 (+ 146us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:09.485429 (+ 117us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:09.485849 (+ 420us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:09.486044 (+ 195us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:09.486088 (+ 44us) write_op.cc:312] APPLY: finished
0812 19:27:09.486301 (+ 213us) log.cc:842] Serialized 29 byte log entry
0812 19:27:09.486450 (+ 149us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.486520 (+ 70us) write_op.cc:454] Released schema lock
0812 19:27:09.486549 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:09.486718 (+ 169us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.486741 (+ 23us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":89948416,"child_traces":[["op",{"apply.queue_time_us":262,"apply.run_cpu_time_us":1852,"apply.run_wall_time_us":1851,"num_ops":2,"prepare.queue_time_us":852400,"raft.queue_time_us":98,"raft.run_cpu_time_us":771,"raft.run_wall_time_us":772,"replication_time_us":12056}]]}
I20260812 19:27:09.497924 8627 tablet_bootstrap.cc:492] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:09.498359 8627 ts_tablet_manager.cc:1397] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.001s
I20260812 19:27:09.504622 8484 tablet_service.cc:1514] Processing DeleteTablet for tablet 613763d1b3074766bee2d026de516065 with delete_type TABLET_DATA_DELETED (replaced by tablet cdb6ba8b98474fff97ae3f45218870f0) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:09.508805 8627 raft_consensus.cc:348] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.509689 8627 raft_consensus.cc:374] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.509982 8627 raft_consensus.cc:729] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.520790 8182 raft_consensus.cc:2454] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:09.524670 9482 ts_tablet_manager.cc:1905] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:09.524840 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:09.524600 8627 consensus_queue.cc:260] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.527446 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:09.531929 7945 catalog_manager.cc:4821] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): delete failed for tablet 613763d1b3074766bee2d026de516065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 613763d1b3074766bee2d026de516065 already in progress: creating tablet
I20260812 19:27:09.522531 8333 tablet_service.cc:1514] Processing DeleteTablet for tablet 613763d1b3074766bee2d026de516065 with delete_type TABLET_DATA_DELETED (replaced by tablet cdb6ba8b98474fff97ae3f45218870f0) from {username='slave'} at 127.0.0.1:44394
W20260812 19:27:09.536751 8278 leader_election.cc:341] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:09.539127 8627 ts_tablet_manager.cc:1428] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.041s user 0.008s sys 0.000s
I20260812 19:27:09.539887 8623 tablet_bootstrap.cc:492] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:09.539959 8627 tablet_bootstrap.cc:492] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:09.540323 8623 ts_tablet_manager.cc:1397] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.936s user 0.004s sys 0.017s
I20260812 19:27:09.542477 8623 raft_consensus.cc:348] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:09.545145 8623 raft_consensus.cc:374] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.545419 8623 raft_consensus.cc:729] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.547827 8627 tablet_bootstrap.cc:654] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:09.546000 8623 consensus_queue.cc:260] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:09.553925 8623 ts_tablet_manager.cc:1428] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20260812 19:27:09.554738 8623 tablet_bootstrap.cc:492] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:09.556053 7960 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:09.562790 7960 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:09.590405 8636 tablet_bootstrap.cc:492] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:09.590840 8636 ts_tablet_manager.cc:1397] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.356s user 0.019s sys 0.018s
I20260812 19:27:09.593758 8636 raft_consensus.cc:348] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.594406 8636 raft_consensus.cc:374] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.594653 8636 raft_consensus.cc:729] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.595376 8514 raft_consensus.cc:3037] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:09.595227 8636 consensus_queue.cc:260] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.596284 8627 tablet_bootstrap.cc:492] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:09.596717 8627 ts_tablet_manager.cc:1397] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.057s user 0.012s sys 0.000s
I20260812 19:27:09.599072 8627 raft_consensus.cc:348] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.599833 8627 raft_consensus.cc:374] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.600132 8627 raft_consensus.cc:729] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.604812 8627 consensus_queue.cc:260] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.606554 8636 ts_tablet_manager.cc:1428] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260812 19:27:09.607455 8636 tablet_bootstrap.cc:492] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:09.629635 8636 tablet_bootstrap.cc:654] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:09.630710 8627 ts_tablet_manager.cc:1428] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20260812 19:27:09.633672 8627 tablet_bootstrap.cc:492] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:09.652650 7946 catalog_manager.cc:4821] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): delete failed for tablet 613763d1b3074766bee2d026de516065 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 613763d1b3074766bee2d026de516065 already in progress: creating tablet
W20260812 19:27:09.649487 8278 consensus_peers.cc:487] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:09.662429 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]). Expected version 2 got 0
I20260812 19:27:09.664499 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:09.670217 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_c2e56d6bab7a4ae9aeb5725ac10e4c50 [id=525ff469b92d436fba5e9319b7ddb9fc]). Expected version 1 got 0
I20260812 19:27:09.670861 8636 tablet_bootstrap.cc:492] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:09.671247 8636 ts_tablet_manager.cc:1397] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.064s user 0.009s sys 0.000s
I20260812 19:27:09.673528 8636 raft_consensus.cc:348] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:09.674196 8636 raft_consensus.cc:374] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.674440 8636 raft_consensus.cc:729] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.675136 8636 consensus_queue.cc:260] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:09.678372 8627 tablet_bootstrap.cc:654] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:09.677606 8636 ts_tablet_manager.cc:1428] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 19:27:09.680914 8636 tablet_bootstrap.cc:492] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:09.681811 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:09.687116 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]). Expected version 1 got 0
I20260812 19:27:09.689340 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]). Expected version 1 got 0
I20260812 19:27:09.693192 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet f7c9e6328b70417cbeecf31f318f9b61 (table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]). Expected version 1 got 0
I20260812 19:27:09.697563 8636 tablet_bootstrap.cc:654] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:09.697688 8107 leader_election.cc:341] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:09.698433 8107 leader_election.cc:302] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:09.699201 7959 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8]). Expected version 2 got 0
I20260812 19:27:09.709098 8636 tablet_bootstrap.cc:492] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:09.709497 8636 ts_tablet_manager.cc:1397] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.029s user 0.008s sys 0.004s
I20260812 19:27:09.711681 8636 raft_consensus.cc:348] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.712352 8636 raft_consensus.cc:374] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.712570 8636 raft_consensus.cc:729] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.714520 8636 consensus_queue.cc:260] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.724524 8636 ts_tablet_manager.cc:1428] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260812 19:27:09.726738 9282 raft_consensus.cc:482] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:09.727208 9282 raft_consensus.cc:504] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.729133 9282 leader_election.cc:288] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:09.730726 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:09.731527 8352 raft_consensus.cc:2379] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:09.733390 8636 tablet_bootstrap.cc:492] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:09.748793 8281 leader_election.cc:302] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:09.749563 9445 raft_consensus.cc:2781] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:09.749910 9445 raft_consensus.cc:482] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260812 19:27:09.750168 8281 consensus_peers.cc:487] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:09.750231 9445 raft_consensus.cc:3037] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:09.758291 8144 tablet_service.cc:1514] Processing DeleteTablet for tablet 613763d1b3074766bee2d026de516065 with delete_type TABLET_DATA_DELETED (replaced by tablet cdb6ba8b98474fff97ae3f45218870f0) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:09.759085 9445 raft_consensus.cc:504] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:09.762850 8514 raft_consensus.cc:1261] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Refusing update from remote peer 6a95b50ceede4dc99913aec28ddaa380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:09.767099 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6075b2e46524829962d2b84353013b2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:09.768551 8514 raft_consensus.cc:3037] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:09.777626 9445 leader_election.cc:288] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:09.785108 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:09.786424 8180 raft_consensus.cc:2454] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:09.775952 8514 raft_consensus.cc:2454] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:09.794203 8278 leader_election.cc:302] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:09.795079 9445 raft_consensus.cc:2781] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:09.795981 9445 raft_consensus.cc:686] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:09.797314 9445 consensus_queue.cc:237] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:09.796206 8157 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 279) took 1105 ms. Trace:
I20260812 19:27:09.803145 8157 rpcz_store.cc:276] 0812 19:27:08.690538 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.690649 (+ 111us) service_pool.cc:227] Handling call
0812 19:27:09.045375 (+354726us) spinlock_profiling.cc:243] Waited 3.14 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4b7c 00007f98318e473b 00007f983a76fb09 00007f98397cc730 00007f98398aed21 00007f983988c1e3 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2 00007f9837f2fb01
0812 19:27:09.118757 (+ 73382us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.118843 (+ 86us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.355003 (+236160us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:09.795271 (+440268us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:09.795993 (+ 722us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7226624}
I20260812 19:27:09.572191 8623 tablet_bootstrap.cc:654] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:09.588709 9482 ts_tablet_manager.cc:1918] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:09.861469 9482 log.cc:1196] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:09.862583 9482 ts_tablet_manager.cc:1939] T 249da5c0bd73498bbfc8f41e7513a9d4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:09.863615 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 265) took 2983 ms. Trace:
I20260812 19:27:09.863929 9482 rpcz_store.cc:276] 0812 19:27:06.879854 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.880000 (+ 146us) service_pool.cc:227] Handling call
0812 19:27:08.843883 (+1963883us) ts_tablet_manager.cc:1145] Deleting tablet 249da5c0bd73498bbfc8f41e7513a9d4
0812 19:27:09.014728 (+170845us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:09.549681 (+534953us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:09.588313 (+ 38632us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:09.863520 (+275207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":93845,"tablet-delete.queue_time_us":1963216}
I20260812 19:27:09.865909 9482 tablet_replica.cc:330] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:09.866664 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 249da5c0bd73498bbfc8f41e7513a9d4 (table default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]) successfully deleted
I20260812 19:27:09.886758 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]). Expected version 1 got 0
I20260812 19:27:09.889036 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:09.897007 8627 tablet_bootstrap.cc:492] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:09.897643 8627 ts_tablet_manager.cc:1397] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.264s user 0.015s sys 0.028s
I20260812 19:27:09.900123 8627 raft_consensus.cc:348] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.901042 8627 raft_consensus.cc:374] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:09.901546 8627 raft_consensus.cc:729] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:09.902455 8627 consensus_queue.cc:260] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:09.891492 7948 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet fac74fcb73d1489f8542496293d6141c (table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet fac74fcb73d1489f8542496293d6141c consensus state has no leader
I20260812 19:27:09.916983 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]). Expected version 1 got 0
I20260812 19:27:09.917795 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]). Expected version 1 got 0
I20260812 19:27:09.918757 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_c2e56d6bab7a4ae9aeb5725ac10e4c50 [id=525ff469b92d436fba5e9319b7ddb9fc]). Expected version 1 got 0
I20260812 19:27:09.919301 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet f7c9e6328b70417cbeecf31f318f9b61 (table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]). Expected version 1 got 0
I20260812 19:27:09.920200 7953 catalog_manager.cc:5587] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029) does not have the latest schema for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8]). Expected version 2 got 0
I20260812 19:27:09.921414 9619 consensus_queue.cc:1035] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.115s
I20260812 19:27:09.921999 8627 ts_tablet_manager.cc:1428] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20260812 19:27:09.923040 8627 tablet_bootstrap.cc:492] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:09.930857 9623 log.cc:924] Time spent T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: Append to log took a long time: real 0.100s user 0.026s sys 0.000s
W20260812 19:27:09.946041 8148 consensus_meta.cc:287] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 1.177s user 0.004s sys 0.006s
I20260812 19:27:09.953240 9617 raft_consensus.cc:482] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:09.953722 9617 raft_consensus.cc:504] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:09.955701 9617 leader_election.cc:288] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:09.957492 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:09.958884 8278 leader_election.cc:341] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:09.975926 9425 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46746 (request call id 0) took 2249 ms. Trace:
I20260812 19:27:09.977041 9630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:09.977622 9630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:09.981695 9579 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:09.982511 9579 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:09.984602 9630 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
W20260812 19:27:09.993587 8108 consensus_peers.cc:487] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:09.997131 8158 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 277) took 1309 ms. Trace:
I20260812 19:27:09.997597 8158 rpcz_store.cc:276] 0812 19:27:08.687541 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.687651 (+ 110us) service_pool.cc:227] Handling call
0812 19:27:09.046997 (+359346us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4b7c 00007f98318e473b 00007f983a76fb09 00007f98397cc730 00007f98398aed21 00007f983988c1e3 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2 00007f9837f2fb01
0812 19:27:09.119680 (+ 72683us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.119758 (+ 78us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.529171 (+409413us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:09.996536 (+467365us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:09.996964 (+ 428us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7357824}
I20260812 19:27:10.017252 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5717f521074d49c6baec431f0d739c91" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.018148 8182 raft_consensus.cc:2379] T 5717f521074d49c6baec431f0d739c91 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:10.019430 8627 tablet_bootstrap.cc:654] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.020915 8446 leader_election.cc:302] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:10.022806 9282 raft_consensus.cc:3037] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.034657 9282 raft_consensus.cc:2726] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:10.035652 8636 tablet_bootstrap.cc:654] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.037931 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.041364 8175 raft_consensus.cc:2454] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:10.049060 9482 raft_consensus.cc:2229] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:10.050707 9560 raft_consensus.cc:482] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.051177 9560 raft_consensus.cc:504] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:10.054837 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:10.056319 8107 leader_election.cc:341] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:10.056878 9560 leader_election.cc:288] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
W20260812 19:27:10.062520 8176 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s user 0.015s sys 0.002s
W20260812 19:27:10.062899 8176 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s user 0.015s sys 0.002s
I20260812 19:27:10.064013 9482 pending_rounds.cc:62] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:27:10.064373 9482 pending_rounds.cc:68] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7317761344976560128 op_type: NO_OP noop_request { }
I20260812 19:27:10.065105 9482 raft_consensus.cc:2866] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:10.065591 9482 raft_consensus.cc:2258] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:10.068288 8636 tablet_bootstrap.cc:492] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:10.068699 8636 ts_tablet_manager.cc:1397] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.335s user 0.012s sys 0.005s
W20260812 19:27:10.069026 8151 consensus_meta.cc:287] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.729s user 0.006s sys 0.003s
I20260812 19:27:10.070901 8636 raft_consensus.cc:348] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.071563 8636 raft_consensus.cc:374] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.071806 8636 raft_consensus.cc:729] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:10.064298 9632 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 19:27:10.083814 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:10.095084 8108 leader_election.cc:341] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:10.095769 8108 leader_election.cc:302] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:10.096757 9641 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:10.097361 9641 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:10.103931 8148 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 275) took 1642 ms. Trace:
I20260812 19:27:10.104411 8148 rpcz_store.cc:276] 0812 19:27:08.461428 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.476333 (+ 14905us) service_pool.cc:227] Handling call
0812 19:27:08.478121 (+ 1788us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:08.478256 (+ 135us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:08.768604 (+290348us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:09.946686 (+1178082us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.061711 (+115025us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4851 00007f98318e4e82 00007f983a7988b9 00007f98397cc5d8 00007f9839890063 00007f983988be2f 00007f983988c5ed 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2
0812 19:27:10.103869 (+ 42158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":113158528}
I20260812 19:27:10.108598 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 316 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:10.108701 8151 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 276) took 1470 ms. Trace:
I20260812 19:27:10.109105 8151 rpcz_store.cc:276] 0812 19:27:08.638189 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.638442 (+ 253us) service_pool.cc:227] Handling call
0812 19:27:08.656578 (+ 18136us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:08.656694 (+ 116us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.251459 (+594765us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.069570 (+818111us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.108638 (+ 39068us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:10.112668 9641 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:10.121119 9560 raft_consensus.cc:2726] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:10.123522 8156 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 281) took 1333 ms. Trace:
I20260812 19:27:10.124100 8156 rpcz_store.cc:276] 0812 19:27:08.783764 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.783905 (+ 141us) service_pool.cc:227] Handling call
0812 19:27:09.036784 (+252879us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4b7c 00007f98318e473b 00007f983a76fb09 00007f98397cc730 00007f98398aed21 00007f983988c1e3 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2 00007f9837f2fb01
0812 19:27:09.112465 (+ 75681us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.112556 (+ 91us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.947228 (+834672us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.045394 (+ 98166us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.117445 (+ 72051us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7089408}
I20260812 19:27:10.126382 9560 raft_consensus.cc:482] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.126922 9560 raft_consensus.cc:504] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.129961 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:10.131587 8107 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:10.133395 9619 raft_consensus.cc:482] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.133862 9619 raft_consensus.cc:504] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.137555 8410 heartbeater.cc:347] Connected to a master server at 127.7.144.253:41563
I20260812 19:27:10.135607 8636 consensus_queue.cc:260] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.146306 8636 ts_tablet_manager.cc:1428] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.077s user 0.005s sys 0.000s
I20260812 19:27:10.148211 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:10.150751 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 400040us
I20260812 19:27:10.151533 9619 leader_election.cc:288] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:10.152102 8107 leader_election.cc:341] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:10.152940 9616 raft_consensus.cc:2726] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:10.068181 9482 ts_tablet_manager.cc:1905] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:10.161252 8152 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 280) took 1469 ms. Trace:
I20260812 19:27:10.161791 8152 rpcz_store.cc:276] 0812 19:27:08.692131 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.692225 (+ 94us) service_pool.cc:227] Handling call
0812 19:27:09.047526 (+355301us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4b7c 00007f98318e473b 00007f983a76fb09 00007f98397cc730 00007f98398aed21 00007f983988c1e3 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2 00007f9837f2fb01
0812 19:27:09.120354 (+ 72828us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.120425 (+ 71us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.887677 (+767252us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.136843 (+249166us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.161032 (+ 24189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7008128}
I20260812 19:27:10.154803 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:10.188418 8354 raft_consensus.cc:2454] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:10.189833 8627 tablet_bootstrap.cc:492] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:10.190259 8627 ts_tablet_manager.cc:1397] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.267s user 0.011s sys 0.007s
I20260812 19:27:10.214582 8627 raft_consensus.cc:348] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.215345 8627 raft_consensus.cc:374] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.215618 8627 raft_consensus.cc:729] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:27:10.216553 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 49012.6us
I20260812 19:27:10.218086 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 298 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:10.218283 8281 leader_election.cc:302] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:10.219173 9449 raft_consensus.cc:2781] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:10.219795 9449 raft_consensus.cc:686] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:10.221027 9449 consensus_queue.cc:237] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.253262 9282 raft_consensus.cc:482] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.253947 9282 raft_consensus.cc:504] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.258245 9282 leader_election.cc:288] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:10.191016 8108 leader_election.cc:302] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:27:10.263154 9631 log.cc:924] Time spent T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.083s user 0.000s sys 0.000s
W20260812 19:27:10.275024 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 56900.6us
I20260812 19:27:10.276072 9617 consensus_queue.cc:1035] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:10.283536 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:10.214107 8623 tablet_bootstrap.cc:492] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:10.253136 8155 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 282) took 1178 ms. Trace:
I20260812 19:27:10.297631 8636 tablet_bootstrap.cc:492] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:10.293159 8155 rpcz_store.cc:276] 0812 19:27:09.013256 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.013366 (+ 110us) service_pool.cc:227] Handling call
0812 19:27:09.046443 (+ 33077us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4851 00007f98318e4702 00007f983a76fb09 00007f98397cc730 00007f98398aed21 00007f983988c1e3 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2 00007f9837f2fb01
0812 19:27:09.118996 (+ 72553us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.119076 (+ 80us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.882613 (+763537us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.150236 (+267623us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.191764 (+ 41528us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8303488}
I20260812 19:27:10.325608 8636 tablet_bootstrap.cc:654] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.337182 9449 raft_consensus.cc:482] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.343703 9561 raft_consensus.cc:2781] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:10.344240 9561 raft_consensus.cc:482] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:10.351568 9561 raft_consensus.cc:3037] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.335829 9560 leader_election.cc:288] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:10.372187 8154 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 278) took 1498 ms. Trace:
I20260812 19:27:10.372761 8154 rpcz_store.cc:276] 0812 19:27:08.689186 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.689288 (+ 102us) service_pool.cc:227] Handling call
0812 19:27:09.044620 (+355332us) spinlock_profiling.cc:243] Waited 3.17 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4b7c 00007f98318e473b 00007f983a76fb09 00007f98397cc730 00007f98398aed21 00007f983988c1e3 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2 00007f9837f2fb01
0812 19:27:09.116321 (+ 71701us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.116450 (+ 129us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.959613 (+843163us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.087836 (+128223us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.187695 (+ 99859us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7293312}
W20260812 19:27:10.338248 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 147321us
I20260812 19:27:10.385579 9559 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:10.386405 9559 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.379411 8623 ts_tablet_manager.cc:1397] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.825s user 0.015s sys 0.009s
I20260812 19:27:10.389030 9619 raft_consensus.cc:482] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.395541 9619 raft_consensus.cc:504] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.399186 9619 leader_election.cc:288] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:10.402016 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a06d3ff29cc14599bce1531a7b63f072" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.403299 8176 raft_consensus.cc:2379] T a06d3ff29cc14599bce1531a7b63f072 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:10.405766 8446 leader_election.cc:302] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:10.417114 8147 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 283) took 1323 ms. Trace:
I20260812 19:27:10.417881 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 316 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:10.422639 9424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa34b607af684984bbfb5cd60a2f058d in term 1.
I20260812 19:27:10.424836 7777 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, fa34b607af684984bbfb5cd60a2f058d; no voters: b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:10.425379 9405 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" instance_seqno: 1786562804980370) as {username='slave'} at 127.7.144.195:44579; Asking this server to re-register.
I20260812 19:27:10.425997 9641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:10.426424 9641 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Starting leader election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:10.426910 9641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:10.448302 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 298 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:10.451911 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:10.454279 9630 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:10.380957 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:10.406985 9445 raft_consensus.cc:482] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.427910 8627 consensus_queue.cc:260] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.469031 9445 raft_consensus.cc:504] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.470590 8627 ts_tablet_manager.cc:1428] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.260s user 0.003s sys 0.003s
I20260812 19:27:10.471503 8627 tablet_bootstrap.cc:492] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:10.472707 9445 leader_election.cc:288] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:10.473621 9449 raft_consensus.cc:504] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.475332 8354 raft_consensus.cc:2454] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:10.480206 8627 tablet_bootstrap.cc:654] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.483265 9445 raft_consensus.cc:482] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.483987 9445 raft_consensus.cc:504] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.486657 9445 leader_election.cc:288] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:10.489427 8569 heartbeater.cc:464] Registering TS with master...
I20260812 19:27:10.543401 8512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:10.547053 8107 leader_election.cc:341] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:10.417591 8147 rpcz_store.cc:276] 0812 19:27:09.032982 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.033102 (+ 120us) service_pool.cc:227] Handling call
0812 19:27:09.109821 (+ 76719us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.109917 (+ 96us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:10.006445 (+896528us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.306860 (+300415us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.356132 (+ 49272us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:09.976336 9425 rpcz_store.cc:276] 0812 19:27:07.726440 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.726679 (+ 239us) service_pool.cc:227] Handling call
0812 19:27:09.186850 (+1460171us) raft_consensus.cc:1457] Updating replica for 294 ops
0812 19:27:09.422655 (+235805us) raft_consensus.cc:1520] Early marking committed up to index 0
0812 19:27:09.422799 (+ 144us) raft_consensus.cc:1525] Triggering prepare for 294 ops
0812 19:27:09.423610 (+ 811us) write_op.cc:270] Start()
0812 19:27:09.423819 (+ 209us) write_op.cc:276] Timestamp: P: 1786562805198279 usec, L: 0
0812 19:27:09.523004 (+ 99185us) write_op.cc:270] Start()
0812 19:27:09.523096 (+ 92us) write_op.cc:276] Timestamp: P: 1786562805228680 usec, L: 0
0812 19:27:09.523667 (+ 571us) write_op.cc:270] Start()
0812 19:27:09.523801 (+ 134us) write_op.cc:276] Timestamp: P: 1786562805231709 usec, L: 0
0812 19:27:09.530969 (+ 7168us) write_op.cc:270] Start()
0812 19:27:09.531095 (+ 126us) write_op.cc:276] Timestamp: P: 1786562805237797 usec, L: 0
0812 19:27:09.531723 (+ 628us) write_op.cc:270] Start()
0812 19:27:09.531823 (+ 100us) write_op.cc:276] Timestamp: P: 1786562805270867 usec, L: 0
0812 19:27:09.535667 (+ 3844us) write_op.cc:270] Start()
0812 19:27:09.535779 (+ 112us) write_op.cc:276] Timestamp: P: 1786562805299401 usec, L: 0
0812 19:27:09.536333 (+ 554us) write_op.cc:270] Start()
0812 19:27:09.536482 (+ 149us) write_op.cc:276] Timestamp: P: 1786562805301726 usec, L: 0
0812 19:27:09.542368 (+ 5886us) write_op.cc:270] Start()
0812 19:27:09.542483 (+ 115us) write_op.cc:276] Timestamp: P: 1786562805362744 usec, L: 0
0812 19:27:09.543163 (+ 680us) write_op.cc:270] Start()
0812 19:27:09.543372 (+ 209us) write_op.cc:276] Timestamp: P: 1786562805387583 usec, L: 0
0812 19:27:09.544145 (+ 773us) write_op.cc:270] Start()
0812 19:27:09.544226 (+ 81us) write_op.cc:276] Timestamp: P: 1786562805393337 usec, L: 0
0812 19:27:09.545666 (+ 1440us) write_op.cc:270] Start()
0812 19:27:09.545763 (+ 97us) write_op.cc:276] Timestamp: P: 1786562805480964 usec, L: 0
0812 19:27:09.546252 (+ 489us) write_op.cc:270] Start()
0812 19:27:09.546360 (+ 108us) write_op.cc:276] Timestamp: P: 1786562805499598 usec, L: 0
0812 19:27:09.546826 (+ 466us) write_op.cc:270] Start()
0812 19:27:09.546901 (+ 75us) write_op.cc:276] Timestamp: P: 1786562805609563 usec, L: 0
0812 19:27:09.547327 (+ 426us) write_op.cc:270] Start()
0812 19:27:09.547401 (+ 74us) write_op.cc:276] Timestamp: P: 1786562805619268 usec, L: 0
0812 19:27:09.547876 (+ 475us) write_op.cc:270] Start()
0812 19:27:09.547966 (+ 90us) write_op.cc:276] Timestamp: P: 1786562805699554 usec, L: 0
0812 19:27:09.552604 (+ 4638us) write_op.cc:270] Start()
0812 19:27:09.552815 (+ 211us) write_op.cc:276] Timestamp: P: 1786562805713413 usec, L: 0
0812 19:27:09.553365 (+ 550us) write_op.cc:270] Start()
0812 19:27:09.553460 (+ 95us) write_op.cc:276] Timestamp: P: 1786562805892834 usec, L: 0
0812 19:27:09.557038 (+ 3578us) write_op.cc:270] Start()
0812 19:27:09.557143 (+ 105us) write_op.cc:276] Timestamp: P: 1786562805920740 usec, L: 0
0812 19:27:09.557733 (+ 590us) write_op.cc:270] Start()
0812 19:27:09.557839 (+ 106us) write_op.cc:276] Timestamp: P: 1786562805930522 usec, L: 0
0812 19:27:09.558558 (+ 719us) write_op.cc:270] Start()
0812 19:27:09.558659 (+ 101us) write_op.cc:276] Timestamp: P: 1786562805992555 usec, L: 0
0812 19:27:09.560295 (+ 1636us) write_op.cc:270] Start()
0812 19:27:09.560424 (+ 129us) write_op.cc:276] Timestamp: P: 1786562806035547 usec, L: 0
0812 19:27:09.561237 (+ 813us) write_op.cc:270] Start()
0812 19:27:09.561378 (+ 141us) write_op.cc:276] Timestamp: P: 1786562806066657 usec, L: 0
0812 19:27:09.562047 (+ 669us) write_op.cc:270] Start()
0812 19:27:09.562142 (+ 95us) write_op.cc:276] Timestamp: P: 1786562806117864 usec, L: 0
0812 19:27:09.562986 (+ 844us) write_op.cc:270] Start()
0812 19:27:09.563177 (+ 191us) write_op.cc:276] Timestamp: P: 1786562806162355 usec, L: 0
0812 19:27:09.564416 (+ 1239us) write_op.cc:270] Start()
0812 19:27:09.564560 (+ 144us) write_op.cc:276] Timestamp: P: 1786562806233056 usec, L: 0
0812 19:27:09.565344 (+ 784us) write_op.cc:270] Start()
0812 19:27:09.565466 (+ 122us) write_op.cc:276] Timestamp: P: 1786562806271402 usec, L: 0
0812 19:27:09.566588 (+ 1122us) write_op.cc:270] Start()
0812 19:27:09.566747 (+ 159us) write_op.cc:276] Timestamp: P: 1786562806291877 usec, L: 0
0812 19:27:09.567855 (+ 1108us) write_op.cc:270] Start()
0812 19:27:09.567968 (+ 113us) write_op.cc:276] Timestamp: P: 1786562806366683 usec, L: 0
0812 19:27:09.568645 (+ 677us) write_op.cc:270] Start()
0812 19:27:09.568799 (+ 154us) write_op.cc:276] Timestamp: P: 1786562806390009 usec, L: 0
0812 19:27:09.569726 (+ 927us) write_op.cc:270] Start()
0812 19:27:09.569895 (+ 169us) write_op.cc:276] Timestamp: P: 1786562806420190 usec, L: 0
0812 19:27:09.570727 (+ 832us) write_op.cc:270] Start()
0812 19:27:09.570847 (+ 120us) write_op.cc:276] Timestamp: P: 1786562806492508 usec, L: 0
0812 19:27:09.571841 (+ 994us) write_op.cc:270] Start()
0812 19:27:09.571965 (+ 124us) write_op.cc:276] Timestamp: P: 1786562806532131 usec, L: 0
0812 19:27:09.572814 (+ 849us) write_op.cc:270] Start()
0812 19:27:09.572919 (+ 105us) write_op.cc:276] Timestamp: P: 1786562806581977 usec, L: 0
0812 19:27:09.574848 (+ 1929us) write_op.cc:270] Start()
0812 19:27:09.574965 (+ 117us) write_op.cc:276] Timestamp: P: 1786562806633788 usec, L: 0
0812 19:27:09.575780 (+ 815us) write_op.cc:270] Start()
0812 19:27:09.575913 (+ 133us) write_op.cc:276] Timestamp: P: 1786562806656962 usec, L: 0
0812 19:27:09.576505 (+ 592us) write_op.cc:270] Start()
0812 19:27:09.576610 (+ 105us) write_op.cc:276] Timestamp: P: 1786562806667043 usec, L: 0
0812 19:27:09.577728 (+ 1118us) write_op.cc:270] Start()
0812 19:27:09.577914 (+ 186us) write_op.cc:276] Timestamp: P: 1786562806671110 usec, L: 0
0812 19:27:09.578532 (+ 618us) write_op.cc:270] Start()
0812 19:27:09.578631 (+ 99us) write_op.cc:276] Timestamp: P: 1786562806674631 usec, L: 0
0812 19:27:09.579294 (+ 663us) write_op.cc:270] Start()
0812 19:27:09.579393 (+ 99us) write_op.cc:276] Timestamp: P: 1786562806730802 usec, L: 0
0812 19:27:09.580066 (+ 673us) write_op.cc:270] Start()
0812 19:27:09.580216 (+ 150us) write_op.cc:276] Timestamp: P: 1786562806788676 usec, L: 0
0812 19:27:09.580983 (+ 767us) write_op.cc:270] Start()
0812 19:27:09.581101 (+ 118us) write_op.cc:276] Timestamp: P: 1786562806842880 usec, L: 0
0812 19:27:09.581928 (+ 827us) write_op.cc:270] Start()
0812 19:27:09.582113 (+ 185us) write_op.cc:276] Timestamp: P: 1786562806870744 usec, L: 0
0812 19:27:09.582896 (+ 783us) write_op.cc:270] Start()
0812 19:27:09.583005 (+ 109us) write_op.cc:276] Timestamp: P: 1786562806924493 usec, L: 0
0812 19:27:09.583695 (+ 690us) write_op.cc:270] Start()
0812 19:27:09.583869 (+ 174us) write_op.cc:276] Timestamp: P: 1786562807022181 usec, L: 0
0812 19:27:09.584652 (+ 783us) write_op.cc:270] Start()
0812 19:27:09.584793 (+ 141us) write_op.cc:276] Timestamp: P: 1786562807115129 usec, L: 0
0812 19:27:09.585549 (+ 756us) write_op.cc:270] Start()
0812 19:27:09.585710 (+ 161us) write_op.cc:276] Timestamp: P: 1786562807213622 usec, L: 0
0812 19:27:09.586456 (+ 746us) write_op.cc:270] Start()
0812 19:27:09.586560 (+ 104us) write_op.cc:276] Timestamp: P: 1786562807215785 usec, L: 0
0812 19:27:09.587301 (+ 741us) write_op.cc:270] Start()
0812 19:27:09.587706 (+ 405us) write_op.cc:276] Timestamp: P: 1786562807217655 usec, L: 0
0812 19:27:09.588582 (+ 876us) write_op.cc:270] Start()
0812 19:27:09.588731 (+ 149us) write_op.cc:276] Timestamp: P: 1786562807219396 usec, L: 0
0812 19:27:09.589509 (+ 778us) write_op.cc:270] Start()
0812 19:27:09.589624 (+ 115us) write_op.cc:276] Timestamp: P: 1786562807265922 usec, L: 0
0812 19:27:09.590580 (+ 956us) write_op.cc:270] Start()
0812 19:27:09.590793 (+ 213us) write_op.cc:276] Timestamp: P: 1786562807279887 usec, L: 0
0812 19:27:09.591289 (+ 496us) write_op.cc:270] Start()
0812 19:27:09.591382 (+ 93us) write_op.cc:276] Timestamp: P: 1786562807381993 usec, L: 0
0812 19:27:09.591862 (+ 480us) write_op.cc:270] Start()
0812 19:27:09.591950 (+ 88us) write_op.cc:276] Timestamp: P: 1786562807393671 usec, L: 0
0812 19:27:09.592421 (+ 471us) write_op.cc:270] Start()
0812 19:27:09.592504 (+ 83us) write_op.cc:276] Timestamp: P: 1786562807535625 usec, L: 0
0812 19:27:09.592979 (+ 475us) write_op.cc:270] Start()
0812 19:27:09.593060 (+ 81us) write_op.cc:276] Timestamp: P: 1786562807552346 usec, L: 0
0812 19:27:09.593672 (+ 612us) write_op.cc:270] Start()
0812 19:27:09.593763 (+ 91us) write_op.cc:276] Timestamp: P: 1786562807576846 usec, L: 0
0812 19:27:09.594262 (+ 499us) write_op.cc:270] Start()
0812 19:27:09.594337 (+ 75us) write_op.cc:276] Timestamp: P: 1786562807623105 usec, L: 0
0812 19:27:09.594812 (+ 475us) write_op.cc:270] Start()
0812 19:27:09.594900 (+ 88us) write_op.cc:276] Timestamp: P: 1786562807675149 usec, L: 0
0812 19:27:09.595399 (+ 499us) write_op.cc:270] Start()
0812 19:27:09.595497 (+ 98us) write_op.cc:276] Timestamp: P: 1786562807715784 usec, L: 0
0812 19:27:09.596367 (+ 870us) write_op.cc:270] Start()
0812 19:27:09.598327 (+ 1960us) write_op.cc:276] Timestamp: P: 1786562807724782 usec, L: 0
0812 19:27:09.599501 (+ 1174us) write_op.cc:270] Start()
0812 19:27:09.599661 (+ 160us) write_op.cc:276] Timestamp: P: 1786562807795629 usec, L: 0
0812 19:27:09.600417 (+ 756us) write_op.cc:270] Start()
0812 19:27:09.600497 (+ 80us) write_op.cc:276] Timestamp: P: 1786562807834181 usec, L: 0
0812 19:27:09.600945 (+ 448us) write_op.cc:270] Start()
0812 19:27:09.601154 (+ 209us) write_op.cc:276] Timestamp: P: 1786562807943603 usec, L: 0
0812 19:27:09.601621 (+ 467us) write_op.cc:270] Start()
0812 19:27:09.601696 (+ 75us) write_op.cc:276] Timestamp: P: 1786562807946716 usec, L: 0
0812 19:27:09.602646 (+ 950us) write_op.cc:270] Start()
0812 19:27:09.602783 (+ 137us) write_op.cc:276] Timestamp: P: 1786562808123097 usec, L: 0
0812 19:27:09.603917 (+ 1134us) write_op.cc:270] Start()
0812 19:27:09.604060 (+ 143us) write_op.cc:276] Timestamp: P: 1786562808139799 usec, L: 0
0812 19:27:09.614388 (+ 10328us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b2c000049b8. stack: 00007f0d9b98d033 00007f0d9b98cf30 00007f0d9b50e534 00000000004db2b4 00000000004db249 00007f0da1bfce11 00007f0da1c0c442 00007f0da2943c11 00007f0da290858a 00007f0da290799e 00007f0da38e42e9 00007f0da20ba684 00007f0da20ba612 00007f0da20ba541 00007f0da20ba4bc 00007f0da20b9772
0812 19:27:09.614719 (+ 331us) write_op.cc:270] Start()
0812 19:27:09.614845 (+ 126us) write_op.cc:276] Timestamp: P: 1786562808226611 usec, L: 0
0812 19:27:09.615385 (+ 540us) write_op.cc:270] Start()
0812 19:27:09.615458 (+ 73us) write_op.cc:276] Timestamp: P: 1786562808231035 usec, L: 0
0812 19:27:09.615904 (+ 446us) write_op.cc:270] Start()
0812 19:27:09.615979 (+ 75us) write_op.cc:276] Timestamp: P: 1786562808236233 usec, L: 0
0812 19:27:09.616441 (+ 462us) write_op.cc:270] Start()
0812 19:27:09.616517 (+ 76us) write_op.cc:276] Timestamp: P: 1786562808241514 usec, L: 0
0812 19:27:09.616951 (+ 434us) write_op.cc:270] Start()
0812 19:27:09.617025 (+ 74us) write_op.cc:276] Timestamp: P: 1786562808405530 usec, L: 0
0812 19:27:09.617418 (+ 393us) write_op.cc:270] Start()
0812 19:27:09.617491 (+ 73us) write_op.cc:276] Timestamp: P: 1786562808475610 usec, L: 0
0812 19:27:09.617883 (+ 392us) write_op.cc:270] Start()
0812 19:27:09.617952 (+ 69us) write_op.cc:276] Timestamp: P: 1786562808491103 usec, L: 0
0812 19:27:09.618382 (+ 430us) write_op.cc:270] Start()
0812 19:27:09.618456 (+ 74us) write_op.cc:276] Timestamp: P: 1786562808496658 usec, L: 0
0812 19:27:09.618865 (+ 409us) write_op.cc:270] Start()
0812 19:27:09.618935 (+ 70us) write_op.cc:276] Timestamp: P: 1786562808845497 usec, L: 0
0812 19:27:09.619357 (+ 422us) write_op.cc:270] Start()
0812 19:27:09.619424 (+ 67us) write_op.cc:276] Timestamp: P: 1786562808973347 usec, L: 0
0812 19:27:09.619851 (+ 427us) write_op.cc:270] Start()
0812 19:27:09.619939 (+ 88us) write_op.cc:276] Timestamp: P: 1786562809040820 usec, L: 0
0812 19:27:09.620545 (+ 606us) write_op.cc:270] Start()
0812 19:27:09.620622 (+ 77us) write_op.cc:276] Timestamp: P: 1786562809097805 usec, L: 0
0812 19:27:09.621229 (+ 607us) write_op.cc:270] Start()
0812 19:27:09.621311 (+ 82us) write_op.cc:276] Timestamp: P: 1786562809129676 usec, L: 0
0812 19:27:09.621802 (+ 491us) write_op.cc:270] Start()
0812 19:27:09.621874 (+ 72us) write_op.cc:276] Timestamp: P: 1786562809168987 usec, L: 0
0812 19:27:09.622291 (+ 417us) write_op.cc:270] Start()
0812 19:27:09.622371 (+ 80us) write_op.cc:276] Timestamp: P: 1786562809176293 usec, L: 0
0812 19:27:09.622858 (+ 487us) write_op.cc:270] Start()
0812 19:27:09.622935 (+ 77us) write_op.cc:276] Timestamp: P: 1786562809190491 usec, L: 0
0812 19:27:09.623315 (+ 380us) write_op.cc:270] Start()
0812 19:27:09.623391 (+ 76us) write_op.cc:276] Timestamp: P: 1786562809291962 usec, L: 0
0812 19:27:09.623818 (+ 427us) write_op.cc:270] Start()
0812 19:27:09.623895 (+ 77us) write_op.cc:276] Timestamp: P: 1786562809435069 usec, L: 0
0812 19:27:09.624388 (+ 493us) write_op.cc:270] Start()
0812 19:27:09.624471 (+ 83us) write_op.cc:276] Timestamp: P: 1786562809698675 usec, L: 0
0812 19:27:09.624904 (+ 433us) write_op.cc:270] Start()
0812 19:27:09.624980 (+ 76us) write_op.cc:276] Timestamp: P: 1786562809823943 usec, L: 0
0812 19:27:09.625374 (+ 394us) write_op.cc:270] Start()
0812 19:27:09.625446 (+ 72us) write_op.cc:276] Timestamp: P: 1786562809838351 usec, L: 0
0812 19:27:09.625864 (+ 418us) write_op.cc:270] Start()
0812 19:27:09.626083 (+ 219us) write_op.cc:276] Timestamp: P: 1786562809842478 usec, L: 0
0812 19:27:09.626506 (+ 423us) write_op.cc:270] Start()
0812 19:27:09.626579 (+ 73us) write_op.cc:276] Timestamp: P: 1786562809863726 usec, L: 0
0812 19:27:09.626980 (+ 401us) write_op.cc:270] Start()
0812 19:27:09.627064 (+ 84us) write_op.cc:276] Timestamp: P: 1786562809959342 usec, L: 0
0812 19:27:09.627598 (+ 534us) write_op.cc:270] Start()
0812 19:27:09.627672 (+ 74us) write_op.cc:276] Timestamp: P: 1786562809969866 usec, L: 0
0812 19:27:09.628105 (+ 433us) write_op.cc:270] Start()
0812 19:27:09.628217 (+ 112us) write_op.cc:276] Timestamp: P: 1786562810040336 usec, L: 0
0812 19:27:09.628788 (+ 571us) write_op.cc:270] Start()
0812 19:27:09.628878 (+ 90us) write_op.cc:276] Timestamp: P: 1786562810078238 usec, L: 0
0812 19:27:09.629307 (+ 429us) write_op.cc:270] Start()
0812 19:27:09.629384 (+ 77us) write_op.cc:276] Timestamp: P: 1786562810295679 usec, L: 0
0812 19:27:09.629855 (+ 471us) write_op.cc:270] Start()
0812 19:27:09.629936 (+ 81us) write_op.cc:276] Timestamp: P: 1786562810319009 usec, L: 0
0812 19:27:09.630346 (+ 410us) write_op.cc:270] Start()
0812 19:27:09.630418 (+ 72us) write_op.cc:276] Timestamp: P: 1786562810366221 usec, L: 0
0812 19:27:09.630813 (+ 395us) write_op.cc:270] Start()
0812 19:27:09.630887 (+ 74us) write_op.cc:276] Timestamp: P: 1786562810429856 usec, L: 0
0812 19:27:09.631313 (+ 426us) write_op.cc:270] Start()
0812 19:27:09.631501 (+ 188us) write_op.cc:276] Timestamp: P: 1786562810460614 usec, L: 0
0812 19:27:09.632028 (+ 527us) write_op.cc:270] Start()
0812 19:27:09.632101 (+ 73us) write_op.cc:276] Timestamp: P: 1786562810603202 usec, L: 0
0812 19:27:09.632593 (+ 492us) write_op.cc:270] Start()
0812 19:27:09.632665 (+ 72us) write_op.cc:276] Timestamp: P: 1786562810651116 usec, L: 0
0812 19:27:09.633229 (+ 564us) write_op.cc:270] Start()
0812 19:27:09.633312 (+ 83us) write_op.cc:276] Timestamp: P: 1786562810668013 usec, L: 0
0812 19:27:09.633780 (+ 468us) write_op.cc:270] Start()
0812 19:27:09.633862 (+ 82us) write_op.cc:276] Timestamp: P: 1786562810912185 usec, L: 0
0812 19:27:09.634296 (+ 434us) write_op.cc:270] Start()
0812 19:27:09.634373 (+ 77us) write_op.cc:276] Timestamp: P: 1786562810958259 usec, L: 0
0812 19:27:09.634823 (+ 450us) write_op.cc:270] Start()
0812 19:27:09.634903 (+ 80us) write_op.cc:276] Timestamp: P: 1786562810989069 usec, L: 0
0812 19:27:09.635364 (+ 461us) write_op.cc:270] Start()
0812 19:27:09.635439 (+ 75us) write_op.cc:276] Timestamp: P: 1786562811037736 usec, L: 0
0812 19:27:09.635918 (+ 479us) write_op.cc:270] Start()
0812 19:27:09.636007 (+ 89us) write_op.cc:276] Timestamp: P: 1786562811058587 usec, L: 0
0812 19:27:09.636477 (+ 470us) write_op.cc:270] Start()
0812 19:27:09.636553 (+ 76us) write_op.cc:276] Timestamp: P: 1786562811081867 usec, L: 0
0812 19:27:09.637008 (+ 455us) write_op.cc:270] Start()
0812 19:27:09.637084 (+ 76us) write_op.cc:276] Timestamp: P: 1786562811089184 usec, L: 0
0812 19:27:09.637513 (+ 429us) write_op.cc:270] Start()
0812 19:27:09.637591 (+ 78us) write_op.cc:276] Timestamp: P: 1786562811109907 usec, L: 0
0812 19:27:09.638038 (+ 447us) write_op.cc:270] Start()
0812 19:27:09.638113 (+ 75us) write_op.cc:276] Timestamp: P: 1786562811167753 usec, L: 0
0812 19:27:09.638549 (+ 436us) write_op.cc:270] Start()
0812 19:27:09.638623 (+ 74us) write_op.cc:276] Timestamp: P: 1786562811230008 usec, L: 0
0812 19:27:09.639046 (+ 423us) write_op.cc:270] Start()
0812 19:27:09.639112 (+ 66us) write_op.cc:276] Timestamp: P: 1786562811294536 usec, L: 0
0812 19:27:09.639502 (+ 390us) write_op.cc:270] Start()
0812 19:27:09.639578 (+ 76us) write_op.cc:276] Timestamp: P: 1786562811299705 usec, L: 0
0812 19:27:09.639979 (+ 401us) write_op.cc:270] Start()
0812 19:27:09.640048 (+ 69us) write_op.cc:276] Timestamp: P: 1786562811505327 usec, L: 0
0812 19:27:09.640588 (+ 540us) write_op.cc:270] Start()
0812 19:27:09.640650 (+ 62us) write_op.cc:276] Timestamp: P: 1786562811545114 usec, L: 0
0812 19:27:09.641031 (+ 381us) write_op.cc:270] Start()
0812 19:27:09.641096 (+ 65us) write_op.cc:276] Timestamp: P: 1786562811549240 usec, L: 0
0812 19:27:09.641450 (+ 354us) write_op.cc:270] Start()
0812 19:27:09.641514 (+ 64us) write_op.cc:276] Timestamp: P: 1786562811565164 usec, L: 0
0812 19:27:09.641857 (+ 343us) write_op.cc:270] Start()
0812 19:27:09.641915 (+ 58us) write_op.cc:276] Timestamp: P: 1786562811596184 usec, L: 0
0812 19:27:09.642275 (+ 360us) write_op.cc:270] Start()
0812 19:27:09.642337 (+ 62us) write_op.cc:276] Timestamp: P: 1786562811619718 usec, L: 0
0812 19:27:09.642886 (+ 549us) write_op.cc:270] Start()
0812 19:27:09.642975 (+ 89us) write_op.cc:276] Timestamp: P: 1786562811698344 usec, L: 0
0812 19:27:09.643405 (+ 430us) write_op.cc:270] Start()
0812 19:27:09.643474 (+ 69us) write_op.cc:276] Timestamp: P: 1786562811715264 usec, L: 0
0812 19:27:09.643899 (+ 425us) write_op.cc:270] Start()
0812 19:27:09.643973 (+ 74us) write_op.cc:276] Timestamp: P: 1786562811721136 usec, L: 0
0812 19:27:09.644353 (+ 380us) write_op.cc:270] Start()
0812 19:27:09.644428 (+ 75us) write_op.cc:276] Timestamp: P: 1786562811730122 usec, L: 0
0812 19:27:09.644812 (+ 384us) write_op.cc:270] Start()
0812 19:27:09.644872 (+ 60us) write_op.cc:276] Timestamp: P: 1786562811753579 usec, L: 0
0812 19:27:09.645216 (+ 344us) write_op.cc:270] Start()
0812 19:27:09.645289 (+ 73us) write_op.cc:276] Timestamp: P: 1786562811858033 usec, L: 0
0812 19:27:09.645649 (+ 360us) write_op.cc:270] Start()
0812 19:27:09.645715 (+ 66us) write_op.cc:276] Timestamp: P: 1786562811862390 usec, L: 0
0812 19:27:09.646600 (+ 885us) write_op.cc:270] Start()
0812 19:27:09.646701 (+ 101us) write_op.cc:276] Timestamp: P: 1786562811866205 usec, L: 0
0812 19:27:09.647204 (+ 503us) write_op.cc:270] Start()
0812 19:27:09.647691 (+ 487us) write_op.cc:276] Timestamp: P: 1786562812017294 usec, L: 0
0812 19:27:09.648568 (+ 877us) write_op.cc:270] Start()
0812 19:27:09.648680 (+ 112us) write_op.cc:276] Timestamp: P: 1786562812137381 usec, L: 0
0812 19:27:09.649223 (+ 543us) write_op.cc:270] Start()
0812 19:27:09.649307 (+ 84us) write_op.cc:276] Timestamp: P: 1786562812162910 usec, L: 0
0812 19:27:09.649885 (+ 578us) write_op.cc:270] Start()
0812 19:27:09.649989 (+ 104us) write_op.cc:276] Timestamp: P: 1786562812219086 usec, L: 0
0812 19:27:09.650482 (+ 493us) write_op.cc:270] Start()
0812 19:27:09.650567 (+ 85us) write_op.cc:276] Timestamp: P: 1786562812388996 usec, L: 0
0812 19:27:09.651121 (+ 554us) write_op.cc:270] Start()
0812 19:27:09.651210 (+ 89us) write_op.cc:276] Timestamp: P: 1786562812390997 usec, L: 0
0812 19:27:09.651692 (+ 482us) write_op.cc:270] Start()
0812 19:27:09.651767 (+ 75us) write_op.cc:276] Timestamp: P: 1786562812683846 usec, L: 0
0812 19:27:09.652147 (+ 380us) write_op.cc:270] Start()
0812 19:27:09.652205 (+ 58us) write_op.cc:276] Timestamp: P: 1786562812692084 usec, L: 0
0812 19:27:09.652600 (+ 395us) write_op.cc:270] Start()
0812 19:27:09.652659 (+ 59us) write_op.cc:276] Timestamp: P: 1786562812759448 usec, L: 0
0812 19:27:09.653177 (+ 518us) write_op.cc:270] Start()
0812 19:27:09.653236 (+ 59us) write_op.cc:276] Timestamp: P: 1786562812946326 usec, L: 0
0812 19:27:09.653607 (+ 371us) write_op.cc:270] Start()
0812 19:27:09.653671 (+ 64us) write_op.cc:276] Timestamp: P: 1786562813082205 usec, L: 0
0812 19:27:09.654078 (+ 407us) write_op.cc:270] Start()
0812 19:27:09.654155 (+ 77us) write_op.cc:276] Timestamp: P: 1786562813084685 usec, L: 0
0812 19:27:09.654566 (+ 411us) write_op.cc:270] Start()
0812 19:27:09.654632 (+ 66us) write_op.cc:276] Timestamp: P: 1786562813086817 usec, L: 0
0812 19:27:09.655035 (+ 403us) write_op.cc:270] Start()
0812 19:27:09.655105 (+ 70us) write_op.cc:276] Timestamp: P: 1786562813088842 usec, L: 0
0812 19:27:09.655478 (+ 373us) write_op.cc:270] Start()
0812 19:27:09.655543 (+ 65us) write_op.cc:276] Timestamp: P: 1786562813235828 usec, L: 0
0812 19:27:09.655932 (+ 389us) write_op.cc:270] Start()
0812 19:27:09.656000 (+ 68us) write_op.cc:276] Timestamp: P: 1786562813277349 usec, L: 0
0812 19:27:09.656415 (+ 415us) write_op.cc:270] Start()
0812 19:27:09.656482 (+ 67us) write_op.cc:276] Timestamp: P: 1786562813374401 usec, L: 0
0812 19:27:09.656871 (+ 389us) write_op.cc:270] Start()
0812 19:27:09.656936 (+ 65us) write_op.cc:276] Timestamp: P: 1786562813525537 usec, L: 0
0812 19:27:09.657307 (+ 371us) write_op.cc:270] Start()
0812 19:27:09.657371 (+ 64us) write_op.cc:276] Timestamp: P: 1786562813756975 usec, L: 0
0812 19:27:09.657737 (+ 366us) write_op.cc:270] Start()
0812 19:27:09.657811 (+ 74us) write_op.cc:276] Timestamp: P: 1786562813786614 usec, L: 0
0812 19:27:09.658181 (+ 370us) write_op.cc:270] Start()
0812 19:27:09.658247 (+ 66us) write_op.cc:276] Timestamp: P: 1786562813790776 usec, L: 0
0812 19:27:09.658614 (+ 367us) write_op.cc:270] Start()
0812 19:27:09.658686 (+ 72us) write_op.cc:276] Timestamp: P: 1786562813794147 usec, L: 0
0812 19:27:09.659119 (+ 433us) write_op.cc:270] Start()
0812 19:27:09.659194 (+ 75us) write_op.cc:276] Timestamp: P: 1786562813803875 usec, L: 0
0812 19:27:09.659639 (+ 445us) write_op.cc:270] Start()
0812 19:27:09.659700 (+ 61us) write_op.cc:276] Timestamp: P: 1786562813807037 usec, L: 0
0812 19:27:09.660070 (+ 370us) write_op.cc:270] Start()
0812 19:27:09.660132 (+ 62us) write_op.cc:276] Timestamp: P: 1786562813833544 usec, L: 0
0812 19:27:09.660544 (+ 412us) write_op.cc:270] Start()
0812 19:27:09.660610 (+ 66us) write_op.cc:276] Timestamp: P: 1786562813994683 usec, L: 0
0812 19:27:09.661000 (+ 390us) write_op.cc:270] Start()
0812 19:27:09.661060 (+ 60us) write_op.cc:276] Timestamp: P: 1786562814093736 usec, L: 0
0812 19:27:09.661459 (+ 399us) write_op.cc:270] Start()
0812 19:27:09.661549 (+ 90us) write_op.cc:276] Timestamp: P: 1786562814096922 usec, L: 0
0812 19:27:09.662057 (+ 508us) write_op.cc:270] Start()
0812 19:27:09.662155 (+ 98us) write_op.cc:276] Timestamp: P: 1786562814108356 usec, L: 0
0812 19:27:09.662624 (+ 469us) write_op.cc:270] Start()
0812 19:27:09.662706 (+ 82us) write_op.cc:276] Timestamp: P: 1786562814120203 usec, L: 0
0812 19:27:09.663187 (+ 481us) write_op.cc:270] Start()
0812 19:27:09.663251 (+ 64us) write_op.cc:276] Timestamp: P: 1786562814137977 usec, L: 0
0812 19:27:09.663645 (+ 394us) write_op.cc:270] Start()
0812 19:27:09.663723 (+ 78us) write_op.cc:276] Timestamp: P: 1786562814189143 usec, L: 0
0812 19:27:09.664118 (+ 395us) write_op.cc:270] Start()
0812 19:27:09.664183 (+ 65us) write_op.cc:276] Timestamp: P: 1786562814239854 usec, L: 0
0812 19:27:09.664608 (+ 425us) write_op.cc:270] Start()
0812 19:27:09.664672 (+ 64us) write_op.cc:276] Timestamp: P: 1786562814264592 usec, L: 0
0812 19:27:09.665102 (+ 430us) write_op.cc:270] Start()
0812 19:27:09.665168 (+ 66us) write_op.cc:276] Timestamp: P: 1786562814272856 usec, L: 0
0812 19:27:09.665548 (+ 380us) write_op.cc:270] Start()
0812 19:27:09.665611 (+ 63us) write_op.cc:276] Timestamp: P: 1786562814546437 usec, L: 0
0812 19:27:09.666077 (+ 466us) write_op.cc:270] Start()
0812 19:27:09.666171 (+ 94us) write_op.cc:276] Timestamp: P: 1786562814573324 usec, L: 0
0812 19:27:09.666544 (+ 373us) write_op.cc:270] Start()
0812 19:27:09.666606 (+ 62us) write_op.cc:276] Timestamp: P: 1786562814575307 usec, L: 0
0812 19:27:09.666978 (+ 372us) write_op.cc:270] Start()
0812 19:27:09.667038 (+ 60us) write_op.cc:276] Timestamp: P: 1786562814614169 usec, L: 0
0812 19:27:09.667412 (+ 374us) write_op.cc:270] Start()
0812 19:27:09.667475 (+ 63us) write_op.cc:276] Timestamp: P: 1786562814617953 usec, L: 0
0812 19:27:09.667880 (+ 405us) write_op.cc:270] Start()
0812 19:27:09.667954 (+ 74us) write_op.cc:276] Timestamp: P: 1786562814744935 usec, L: 0
0812 19:27:09.686386 (+ 18432us) write_op.cc:270] Start()
0812 19:27:09.686481 (+ 95us) write_op.cc:276] Timestamp: P: 1786562814998956 usec, L: 0
0812 19:27:09.687171 (+ 690us) write_op.cc:270] Start()
0812 19:27:09.687254 (+ 83us) write_op.cc:276] Timestamp: P: 1786562815178917 usec, L: 0
0812 19:27:09.687676 (+ 422us) write_op.cc:270] Start()
0812 19:27:09.687746 (+ 70us) write_op.cc:276] Timestamp: P: 1786562815214967 usec, L: 0
0812 19:27:09.688309 (+ 563us) write_op.cc:270] Start()
0812 19:27:09.688382 (+ 73us) write_op.cc:276] Timestamp: P: 1786562815432492 usec, L: 0
0812 19:27:09.688785 (+ 403us) write_op.cc:270] Start()
0812 19:27:09.688976 (+ 191us) write_op.cc:276] Timestamp: P: 1786562815617914 usec, L: 0
0812 19:27:09.689366 (+ 390us) write_op.cc:270] Start()
0812 19:27:09.689428 (+ 62us) write_op.cc:276] Timestamp: P: 1786562815695394 usec, L: 0
0812 19:27:09.689837 (+ 409us) write_op.cc:270] Start()
0812 19:27:09.689903 (+ 66us) write_op.cc:276] Timestamp: P: 1786562815745989 usec, L: 0
0812 19:27:09.690929 (+ 1026us) write_op.cc:270] Start()
0812 19:27:09.691001 (+ 72us) write_op.cc:276] Timestamp: P: 1786562815996786 usec, L: 0
0812 19:27:09.691417 (+ 416us) write_op.cc:270] Start()
0812 19:27:09.691496 (+ 79us) write_op.cc:276] Timestamp: P: 1786562816167558 usec, L: 0
0812 19:27:09.691924 (+ 428us) write_op.cc:270] Start()
0812 19:27:09.691996 (+ 72us) write_op.cc:276] Timestamp: P: 1786562816188045 usec, L: 0
0812 19:27:09.692437 (+ 441us) write_op.cc:270] Start()
0812 19:27:09.692504 (+ 67us) write_op.cc:276] Timestamp: P: 1786562816191216 usec, L: 0
0812 19:27:09.692934 (+ 430us) write_op.cc:270] Start()
0812 19:27:09.693002 (+ 68us) write_op.cc:276] Timestamp: P: 1786562816470554 usec, L: 0
0812 19:27:09.693391 (+ 389us) write_op.cc:270] Start()
0812 19:27:09.693455 (+ 64us) write_op.cc:276] Timestamp: P: 1786562816710281 usec, L: 0
0812 19:27:09.693926 (+ 471us) write_op.cc:270] Start()
0812 19:27:09.693988 (+ 62us) write_op.cc:276] Timestamp: P: 1786562816777762 usec, L: 0
0812 19:27:09.694427 (+ 439us) write_op.cc:270] Start()
0812 19:27:09.694493 (+ 66us) write_op.cc:276] Timestamp: P: 1786562816813040 usec, L: 0
0812 19:27:09.694922 (+ 429us) write_op.cc:270] Start()
0812 19:27:09.694997 (+ 75us) write_op.cc:276] Timestamp: P: 1786562816815682 usec, L: 0
0812 19:27:09.695404 (+ 407us) write_op.cc:270] Start()
0812 19:27:09.695477 (+ 73us) write_op.cc:276] Timestamp: P: 1786562816826347 usec, L: 0
0812 19:27:09.695898 (+ 421us) write_op.cc:270] Start()
0812 19:27:09.695971 (+ 73us) write_op.cc:276] Timestamp: P: 1786562817043463 usec, L: 0
0812 19:27:09.696388 (+ 417us) write_op.cc:270] Start()
0812 19:27:09.696452 (+ 64us) write_op.cc:276] Timestamp: P: 1786562817252708 usec, L: 0
0812 19:27:09.696828 (+ 376us) write_op.cc:270] Start()
0812 19:27:09.696888 (+ 60us) write_op.cc:276] Timestamp: P: 1786562817381928 usec, L: 0
0812 19:27:09.697239 (+ 351us) write_op.cc:270] Start()
0812 19:27:09.700761 (+ 3522us) write_op.cc:276] Timestamp: P: 1786562817457771 usec, L: 0
0812 19:27:09.701233 (+ 472us) write_op.cc:270] Start()
0812 19:27:09.701300 (+ 67us) write_op.cc:276] Timestamp: P: 1786562817503738 usec, L: 0
0812 19:27:09.701692 (+ 392us) write_op.cc:270] Start()
0812 19:27:09.701769 (+ 77us) write_op.cc:276] Timestamp: P: 1786562817541614 usec, L: 0
0812 19:27:09.702146 (+ 377us) write_op.cc:270] Start()
0812 19:27:09.702208 (+ 62us) write_op.cc:276] Timestamp: P: 1786562817598080 usec, L: 0
0812 19:27:09.702626 (+ 418us) write_op.cc:270] Start()
0812 19:27:09.702705 (+ 79us) write_op.cc:276] Timestamp: P: 1786562817671954 usec, L: 0
0812 19:27:09.703081 (+ 376us) write_op.cc:270] Start()
0812 19:27:09.703144 (+ 63us) write_op.cc:276] Timestamp: P: 1786562817730351 usec, L: 0
0812 19:27:09.703538 (+ 394us) write_op.cc:270] S
I20260812 19:27:10.560053 9651 raft_consensus.cc:482] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.560758 9651 raft_consensus.cc:504] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:10.563239 8153 consensus_meta.cc:287] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.569s user 0.013s sys 0.000s
W20260812 19:27:10.575419 8146 consensus_meta.cc:287] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.542s user 0.000s sys 0.009s
I20260812 19:27:10.583729 9403 ts_manager.cc:194] Registered new tserver with Master: 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:10.599558 9651 leader_election.cc:288] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:10.503192 9282 raft_consensus.cc:3037] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.607425 8627 tablet_bootstrap.cc:492] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:10.608079 8627 ts_tablet_manager.cc:1397] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.137s user 0.011s sys 0.010s
I20260812 19:27:10.613360 8153 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 285) took 1475 ms. Trace:
I20260812 19:27:10.614058 8153 rpcz_store.cc:276] 0812 19:27:09.138353 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.167935 (+ 29582us) service_pool.cc:227] Handling call
0812 19:27:09.333758 (+165823us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b5800001898. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f9831760f11 00007f98318e4851 00007f98318e4702 00007f983a76fb09 00007f98397cc730 00007f98398aed21 00007f983988c1e3 00007f983983d869 00007f9837f2fc44 00007f9837f2fbd2 00007f9837f2fb01
0812 19:27:09.333898 (+ 140us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.334009 (+ 111us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.983246 (+649237us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.565725 (+582479us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.613250 (+ 47525us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19756928}
I20260812 19:27:10.616551 8627 raft_consensus.cc:348] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.623977 8627 raft_consensus.cc:374] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.624385 8627 raft_consensus.cc:729] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:10.625299 8627 consensus_queue.cc:260] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.627754 8627 ts_tablet_manager.cc:1428] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20260812 19:27:10.628891 8627 tablet_bootstrap.cc:492] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:10.654340 8281 leader_election.cc:302] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:10.655402 9445 raft_consensus.cc:2781] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:10.656050 9445 raft_consensus.cc:482] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:10.656631 9445 raft_consensus.cc:3037] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:10.661120 8446 leader_election.cc:341] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc
I20260812 19:27:10.664139 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:10.665135 8355 raft_consensus.cc:2454] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:10.665843 8627 tablet_bootstrap.cc:654] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.667312 9617 consensus_queue.cc:1035] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:10.616858 8146 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 286) took 1478 ms. Trace:
I20260812 19:27:10.667630 9449 leader_election.cc:288] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:10.673547 8636 tablet_bootstrap.cc:492] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:10.674005 8636 ts_tablet_manager.cc:1397] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.377s user 0.019s sys 0.008s
I20260812 19:27:10.677019 8636 raft_consensus.cc:348] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.677745 8636 raft_consensus.cc:374] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.678011 8636 raft_consensus.cc:729] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:10.678704 8636 consensus_queue.cc:260] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.682600 9559 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:10.684751 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:10.685570 8514 raft_consensus.cc:2454] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:27:10.686476 8149 consensus_meta.cc:287] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.564s user 0.010s sys 0.000s
I20260812 19:27:10.689196 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7764a1ae009142b29d5fb574dca45e21" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:10.690081 8514 raft_consensus.cc:2454] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:10.692641 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e195a643084486a74be961177bf42c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:10.703899 8107 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:10.706555 9282 raft_consensus.cc:2726] T a06d3ff29cc14599bce1531a7b63f072 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:10.707695 8108 leader_election.cc:302] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:10.467907 9405 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" instance_seqno: 1786562803005867) as {username='slave'} at 127.7.144.194:49957; Asking this server to re-register.
I20260812 19:27:10.722402 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:10.723960 8108 leader_election.cc:302] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:10.725795 9282 raft_consensus.cc:482] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.726785 8355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df369d3c4e004c29ac65c5ecf7f8c4cc" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:10.727694 8355 raft_consensus.cc:2454] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
W20260812 19:27:10.729851 8278 leader_election.cc:341] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:10.735172 8278 leader_election.cc:302] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:10.731650 9282 raft_consensus.cc:504] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.733219 9641 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:10.728307 8636 ts_tablet_manager.cc:1428] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.045s user 0.007s sys 0.000s
I20260812 19:27:10.738830 9618 raft_consensus.cc:2781] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:10.739495 9618 raft_consensus.cc:482] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:10.740373 8636 tablet_bootstrap.cc:492] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:10.740195 9618 raft_consensus.cc:3037] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.687078 8623 raft_consensus.cc:348] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.743947 9449 raft_consensus.cc:2781] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:10.744537 9449 raft_consensus.cc:482] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:10.745146 9449 raft_consensus.cc:3037] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:10.746255 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 79009.9us
I20260812 19:27:10.747138 8281 leader_election.cc:302] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:10.747160 9617 consensus_queue.cc:1035] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:10.748788 7802 raft_consensus.cc:1226] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Rejecting Update request from peer b99a815f68ee4d93b167a67778a3e1a6 for earlier term 1. Current term is 2. Ops: [1.317-1.317]
I20260812 19:27:10.779312 8636 tablet_bootstrap.cc:654] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.782471 9645 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:10.784492 9645 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
I20260812 19:27:10.773653 9617 raft_consensus.cc:2781] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:10.790632 9617 raft_consensus.cc:482] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:10.793077 9617 raft_consensus.cc:3037] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.794016 8627 tablet_bootstrap.cc:492] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:10.794466 8627 ts_tablet_manager.cc:1397] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.166s user 0.005s sys 0.013s
I20260812 19:27:10.741127 9560 raft_consensus.cc:2781] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:10.801923 9449 raft_consensus.cc:504] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.806051 9449 leader_election.cc:288] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:10.806335 8627 raft_consensus.cc:348] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:10.822209 8636 tablet_bootstrap.cc:492] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:10.822767 8636 ts_tablet_manager.cc:1397] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.083s user 0.007s sys 0.016s
I20260812 19:27:10.826584 8636 raft_consensus.cc:348] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.828548 8636 raft_consensus.cc:374] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.828940 8636 raft_consensus.cc:729] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:10.829798 8636 consensus_queue.cc:260] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.832778 8636 ts_tablet_manager.cc:1428] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.010s user 0.002s sys 0.005s
I20260812 19:27:10.833899 8636 tablet_bootstrap.cc:492] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:10.809962 8627 raft_consensus.cc:374] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.844641 8627 raft_consensus.cc:729] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:10.845511 8627 consensus_queue.cc:260] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:10.847103 8636 tablet_bootstrap.cc:654] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.848652 8627 ts_tablet_manager.cc:1428] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.054s user 0.005s sys 0.007s
I20260812 19:27:10.849627 8627 tablet_bootstrap.cc:492] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:10.851310 9445 raft_consensus.cc:504] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.862385 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 316 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
I20260812 19:27:10.863581 9445 leader_election.cc:288] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:10.808216 9617 raft_consensus.cc:504] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.866034 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 2 candidate_status { last_received { term: 1 index: 316 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6"
I20260812 19:27:10.867759 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:10.873265 9560 raft_consensus.cc:482] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:10.873749 9560 raft_consensus.cc:3037] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.873828 8149 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 284) took 1735 ms. Trace:
I20260812 19:27:10.873323 8145 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:33126 (request call id 287) took 1662 ms. Trace:
I20260812 19:27:10.742974 8623 raft_consensus.cc:374] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.875140 8623 raft_consensus.cc:729] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
W20260812 19:27:10.880132 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 134410us
I20260812 19:27:10.881979 9617 leader_election.cc:288] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:10.883562 8636 tablet_bootstrap.cc:492] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:10.884032 8636 ts_tablet_manager.cc:1397] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.050s user 0.020s sys 0.023s
I20260812 19:27:10.874148 8149 rpcz_store.cc:276] 0812 19:27:09.138008 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.138399 (+ 391us) service_pool.cc:227] Handling call
0812 19:27:09.309572 (+171173us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.309684 (+ 112us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.976225 (+666541us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.697777 (+721552us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.873759 (+175982us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:10.874477 8145 rpcz_store.cc:276] 0812 19:27:09.139150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.170192 (+ 31042us) service_pool.cc:227] Handling call
0812 19:27:09.202095 (+ 31903us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.202243 (+ 148us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.767507 (+565264us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.596420 (+828913us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.801257 (+204837us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:10.887764 8636 raft_consensus.cc:348] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.888509 8636 raft_consensus.cc:374] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:10.888732 8636 raft_consensus.cc:729] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:10.889559 8636 consensus_queue.cc:260] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.891718 8636 ts_tablet_manager.cc:1428] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20260812 19:27:10.736476 9619 raft_consensus.cc:2781] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:10.892702 8636 tablet_bootstrap.cc:492] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:10.895985 8627 tablet_bootstrap.cc:654] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.897832 9617 raft_consensus.cc:482] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.895949 9619 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:10.898910 8636 tablet_bootstrap.cc:654] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:10.898852 9619 raft_consensus.cc:3037] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:10.898363 9617 raft_consensus.cc:504] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.900919 9617 leader_election.cc:288] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:10.875821 8623 consensus_queue.cc:260] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:10.900319 9561 consensus_meta.cc:287] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.548s user 0.003s sys 0.009s
I20260812 19:27:10.931289 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6075b2e46524829962d2b84353013b2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:10.931900 8175 raft_consensus.cc:3037] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.931293 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.932209 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7764a1ae009142b29d5fb574dca45e21" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.934991 8180 raft_consensus.cc:2454] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:10.672958 8146 rpcz_store.cc:276] 0812 19:27:09.138761 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.157052 (+ 18291us) service_pool.cc:227] Handling call
0812 19:27:09.226836 (+ 69784us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:27:09.227033 (+ 197us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:27:09.775965 (+548932us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:10.594448 (+818483us) tablet_replica.cc:205] Creating consensus instance
0812 19:27:10.616755 (+ 22307us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:10.939087 9653 raft_consensus.cc:482] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:10.939548 9653 raft_consensus.cc:504] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.941823 9653 leader_election.cc:288] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:10.951278 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e195a643084486a74be961177bf42c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.956027 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.956295 8172 raft_consensus.cc:2454] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
W20260812 19:27:10.959172 8446 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 7d660422701a423794416b01cea825b4
I20260812 19:27:10.968178 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:10.930699 9561 raft_consensus.cc:504] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:10.973872 9646 consensus_queue.cc:1046] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 }, Status: INVALID_TERM, Last received: 1.316, Next index: 317, Last known committed idx: 316, Time since last communication: 0.001s
I20260812 19:27:10.982034 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7764a1ae009142b29d5fb574dca45e21" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:10.982271 8180 raft_consensus.cc:2454] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:10.982693 8172 raft_consensus.cc:3037] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:10.983610 8446 leader_election.cc:302] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:10.984658 9653 raft_consensus.cc:2781] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:10.985057 9653 raft_consensus.cc:482] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:10.985399 9653 raft_consensus.cc:3037] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.003949 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:11.006597 8107 leader_election.cc:341] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:11.010412 9561 leader_election.cc:288] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.011662 8175 raft_consensus.cc:2454] T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:11.019953 8623 ts_tablet_manager.cc:1428] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.629s user 0.009s sys 0.000s
I20260812 19:27:11.022589 9282 leader_election.cc:288] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.029830 9641 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 2 election: Requested vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:11.030830 9641 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 19:27:11.035575 9646 raft_consensus.cc:3032] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:27:11.036551 9646 raft_consensus.cc:729] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b99a815f68ee4d93b167a67778a3e1a6, State: Running, Role: LEADER
W20260812 19:27:11.079536 7945 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7764a1ae009142b29d5fb574dca45e21 consensus state has no leader
I20260812 19:27:11.100751 9651 raft_consensus.cc:482] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:11.101341 9651 raft_consensus.cc:504] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.106616 9651 leader_election.cc:288] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.114241 9670 tablet.cc:1722] T 96839764810f4b7e9b3dd7a64be85dd1 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
W20260812 19:27:11.031875 8623 ts_tablet_manager.cc:1460] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380: Tablet startup took 640ms
I20260812 19:27:11.130784 9561 raft_consensus.cc:482] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:11.134492 9561 raft_consensus.cc:504] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.136154 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:11.137079 8175 raft_consensus.cc:2454] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:11.137866 9561 leader_election.cc:288] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.138792 8446 leader_election.cc:302] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:11.139737 9651 raft_consensus.cc:2781] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:11.140074 9651 raft_consensus.cc:482] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:11.140408 9651 raft_consensus.cc:3037] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.140282 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:11.143651 8172 raft_consensus.cc:2454] T 7764a1ae009142b29d5fb574dca45e21 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:11.151208 9651 raft_consensus.cc:504] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:11.151981 8107 leader_election.cc:341] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:11.160144 9646 consensus_queue.cc:260] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 316, Committed index: 316, Last appended: 1.317, Last appended by leader: 317, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:11.162375 9646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:11.172808 9651 leader_election.cc:288] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:11.129566 8623 ts_tablet_manager.cc:1462] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380: Trace:
0812 19:26:57.698580 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:26:57.704405 (+ 5825us) service_pool.cc:227] Handling call
0812 19:26:57.706870 (+ 2465us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0812 19:26:57.707066 (+ 196us) ts_tablet_manager.cc:676] Creating new metadata...
0812 19:26:57.995521 (+288455us) tablet_metadata.cc:641] Metadata flushed
0812 19:26:58.176818 (+181297us) tablet_replica.cc:205] Creating consensus instance
0812 19:26:58.212708 (+ 35890us) inbound_call.cc:173] Queueing success response
0812 19:27:09.554473 (+11341765us) ts_tablet_manager.cc:1373] Bootstrapping tablet
0812 19:27:10.444984 (+890511us) ts_tablet_manager.cc:1429] Starting tablet replica
0812 19:27:10.635380 (+190396us) tablet_replica.cc:259] Starting instrumentation
0812 19:27:10.685098 (+ 49718us) tablet_replica.cc:278] Starting consensus
Metrics: {"raft.queue_time_us":16053,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":202,"tablet-open.queue_time_us":11341954}
I20260812 19:27:11.194430 8627 tablet_bootstrap.cc:492] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:11.194964 8627 ts_tablet_manager.cc:1397] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.346s user 0.045s sys 0.041s
I20260812 19:27:11.197259 8627 raft_consensus.cc:348] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:11.198132 8627 raft_consensus.cc:374] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.198452 8627 raft_consensus.cc:729] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.195737 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:11.199175 8180 raft_consensus.cc:3037] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.199121 8627 consensus_queue.cc:260] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:11.200605 8627 ts_tablet_manager.cc:1428] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260812 19:27:11.201437 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:11.202324 8176 raft_consensus.cc:3037] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.206519 9653 raft_consensus.cc:504] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.192265 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:11.229964 8636 tablet_bootstrap.cc:492] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:11.230453 8636 ts_tablet_manager.cc:1397] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.338s user 0.035s sys 0.093s
I20260812 19:27:11.215302 9560 raft_consensus.cc:504] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.232754 8636 raft_consensus.cc:348] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.233379 8636 raft_consensus.cc:374] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.233598 8636 raft_consensus.cc:729] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.234747 8627 tablet_bootstrap.cc:492] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:11.237844 8636 consensus_queue.cc:260] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.242178 8627 tablet_bootstrap.cc:654] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:11.245934 8278 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s user 0.001s sys 0.003s
W20260812 19:27:11.246424 8278 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.502s user 0.001s sys 0.003s
W20260812 19:27:11.247169 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 503029us
W20260812 19:27:11.248596 8278 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:11.249455 8443 leader_election.cc:302] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:11.250499 9651 raft_consensus.cc:2781] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:11.250798 9651 raft_consensus.cc:482] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:11.251063 9651 raft_consensus.cc:3037] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.252867 8513 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7764a1ae009142b29d5fb574dca45e21" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:11.253613 8513 raft_consensus.cc:3037] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.257460 8281 leader_election.cc:302] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:11.257766 9651 raft_consensus.cc:504] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.258775 9445 raft_consensus.cc:2781] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:11.259131 9445 raft_consensus.cc:482] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:11.259431 9445 raft_consensus.cc:3037] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.262212 8513 raft_consensus.cc:2454] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:11.262555 8636 ts_tablet_manager.cc:1428] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.032s user 0.007s sys 0.001s
I20260812 19:27:11.264711 8636 tablet_bootstrap.cc:492] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:11.232573 8623 tablet_bootstrap.cc:492] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:11.269313 9651 leader_election.cc:288] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.177994 9618 raft_consensus.cc:504] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.278865 8627 tablet_bootstrap.cc:492] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:11.279325 8627 ts_tablet_manager.cc:1397] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.045s user 0.010s sys 0.000s
I20260812 19:27:11.281883 8627 raft_consensus.cc:348] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:11.282568 8627 raft_consensus.cc:374] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.282848 8627 raft_consensus.cc:729] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.283438 8627 consensus_queue.cc:260] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:11.284047 8446 leader_election.cc:341] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc
I20260812 19:27:11.284232 8281 leader_election.cc:302] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:11.285207 8636 tablet_bootstrap.cc:654] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:11.234282 8173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:11.286103 8182 raft_consensus.cc:2379] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:11.286198 8173 raft_consensus.cc:2454] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:11.288038 9619 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.290639 9619 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.292153 9560 leader_election.cc:288] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.294786 9618 leader_election.cc:288] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.296727 8178 raft_consensus.cc:2379] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:11.296989 9654 raft_consensus.cc:2781] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:11.297483 9654 raft_consensus.cc:686] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:11.298331 8627 ts_tablet_manager.cc:1428] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20260812 19:27:11.298286 9654 consensus_queue.cc:237] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:11.298934 9671 log.cc:924] Time spent T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.059s user 0.000s sys 0.000s
I20260812 19:27:11.299304 8627 tablet_bootstrap.cc:492] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:11.301712 8512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a49e46c8ba704680bf12423854883b55" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:11.302316 8512 raft_consensus.cc:3037] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 2
I20260812 19:27:11.303828 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:11.304893 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:11.305543 8627 tablet_bootstrap.cc:654] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:11.305722 8515 raft_consensus.cc:3037] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:11.312682 8107 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:11.315913 9676 log.cc:924] Time spent T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.080s user 0.001s sys 0.000s
W20260812 19:27:11.335052 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 467458us
I20260812 19:27:11.336635 7802 raft_consensus.cc:1226] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Rejecting Update request from peer b99a815f68ee4d93b167a67778a3e1a6 for earlier term 1. Current term is 2. Ops: [1.317-1.317]
I20260812 19:27:11.338516 8627 tablet_bootstrap.cc:492] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:11.338948 8627 ts_tablet_manager.cc:1397] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.040s user 0.009s sys 0.001s
I20260812 19:27:11.341943 8627 raft_consensus.cc:348] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.342701 8627 raft_consensus.cc:374] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.342967 8627 raft_consensus.cc:729] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.343590 8627 consensus_queue.cc:260] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.346810 8627 ts_tablet_manager.cc:1428] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20260812 19:27:11.347822 8627 tablet_bootstrap.cc:492] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:11.361769 9674 log.cc:924] Time spent T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.172s user 0.001s sys 0.000s
I20260812 19:27:11.375815 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:11.376850 8516 raft_consensus.cc:2379] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:11.379072 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:11.380244 8517 raft_consensus.cc:2379] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:11.385056 9560 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:11.386350 8516 raft_consensus.cc:3037] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.385802 9560 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.389815 9560 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.381990 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:11.392091 9445 raft_consensus.cc:504] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.394236 8627 tablet_bootstrap.cc:654] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:11.398909 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:11.399909 8511 raft_consensus.cc:2454] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:11.404543 9659 consensus_queue.cc:1035] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:11.408635 8107 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:11.411520 8281 leader_election.cc:302] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:11.412654 9659 raft_consensus.cc:2781] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:11.413411 9659 raft_consensus.cc:482] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:11.413980 9659 raft_consensus.cc:3037] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.422603 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:11.423085 9653 leader_election.cc:288] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.427225 9667 raft_consensus.cc:2781] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:11.427843 9667 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:11.428470 9667 raft_consensus.cc:3037] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:11.430905 9670 tablet.cc:1722] T e98e0f5b053649f1a5ab315312b37442 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:11.419608 8176 raft_consensus.cc:2454] T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:11.453099 8446 leader_election.cc:302] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:11.454032 9653 raft_consensus.cc:2781] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:11.454748 9653 raft_consensus.cc:686] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:11.456300 9653 consensus_queue.cc:237] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.461112 8410 heartbeater.cc:464] Registering TS with master...
I20260812 19:27:11.464350 9682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:11.465037 9682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:11.476361 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:11.477258 7802 raft_consensus.cc:2379] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in current term 2: Already voted for candidate fa34b607af684984bbfb5cd60a2f058d in this term.
I20260812 19:27:11.500888 9682 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:11.501789 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:11.506014 9401 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" instance_seqno: 1786562800857359) as {username='slave'} at 127.7.144.193:54879; Asking this server to re-register.
I20260812 19:27:11.399629 8180 raft_consensus.cc:2454] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:11.557794 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:11.559615 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:11.559878 8350 raft_consensus.cc:3037] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.565675 8623 tablet_bootstrap.cc:654] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:11.546195 9445 leader_election.cc:288] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:11.581177 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed3743a7dde744668cbe91759a499805" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:11.582074 8353 raft_consensus.cc:3037] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.585094 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:11.585920 8352 raft_consensus.cc:3037] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.590646 7972 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in term 2.
W20260812 19:27:11.591390 9661 catalog_manager.cc:1409] Failed waiting for node to catch up after master election: Illegal state: Node b99a815f68ee4d93b167a67778a3e1a6 not leader. Raft Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:11.593171 9658 raft_consensus.cc:482] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:11.593766 9658 raft_consensus.cc:504] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:11.555788 9482 ts_tablet_manager.cc:1918] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 19:27:11.597652 9482 log.cc:1196] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:11.599119 9482 ts_tablet_manager.cc:1939] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:11.603781 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6; no voters: fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:11.605120 9682 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:11.605471 9682 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Starting leader election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:11.605808 9682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:11.608994 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:11.609594 7802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 2.
I20260812 19:27:11.610738 7948 leader_election.cc:302] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d; no voters:
I20260812 19:27:11.610981 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:11.612057 8354 raft_consensus.cc:2379] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:11.613777 9658 leader_election.cc:288] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563)
I20260812 19:27:11.614293 9658 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:27:11.614360 8352 raft_consensus.cc:2454] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:11.614992 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:11.615402 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:11.617045 8356 raft_consensus.cc:2379] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:11.600227 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 266) took 4699 ms. Trace:
I20260812 19:27:11.627961 9482 rpcz_store.cc:276] 0812 19:27:06.901237 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.901538 (+ 301us) service_pool.cc:227] Handling call
0812 19:27:09.865704 (+2964166us) ts_tablet_manager.cc:1145] Deleting tablet bc5c4ef0441c49fca31b2fc8a2c9abd4
0812 19:27:09.865772 (+ 68us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:11.013990 (+1148218us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:11.525547 (+511557us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:11.600161 (+ 74614us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":162522,"tablet-delete.queue_time_us":2925219}
I20260812 19:27:11.637864 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df369d3c4e004c29ac65c5ecf7f8c4cc" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:11.638720 8354 raft_consensus.cc:3037] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.640743 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04d56a12f8964d4a9ccbc5f870b89713" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:11.641083 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0fd84e685b2b4e819f4b61e442828b13" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:11.641750 8352 raft_consensus.cc:2379] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:11.642513 8356 raft_consensus.cc:2379] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:11.652036 8636 tablet_bootstrap.cc:492] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:11.652545 8636 ts_tablet_manager.cc:1397] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.388s user 0.012s sys 0.049s
I20260812 19:27:11.537781 8515 raft_consensus.cc:2454] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:11.658598 8627 tablet_bootstrap.cc:492] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:11.659060 8627 ts_tablet_manager.cc:1397] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.311s user 0.028s sys 0.013s
W20260812 19:27:11.659888 8443 leader_election.cc:341] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 7d660422701a423794416b01cea825b4
I20260812 19:27:11.538462 8512 raft_consensus.cc:2454] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 2.
W20260812 19:27:11.665660 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 150767us
I20260812 19:27:11.614640 9658 raft_consensus.cc:482] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:11.666910 9658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:11.660358 8443 leader_election.cc:302] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:11.675905 8563 debug-util.cc:398] Leaking SignalData structure 0x7b0800083860 after lost signal to thread 8423
W20260812 19:27:11.677383 8563 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6200 after lost signal to thread 8566
I20260812 19:27:11.682139 9686 tablet.cc:1722] T e98e0f5b053649f1a5ab315312b37442 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:11.680554 9282 raft_consensus.cc:2726] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:11.687474 8281 leader_election.cc:302] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:11.692849 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e195a643084486a74be961177bf42c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:11.701020 8627 raft_consensus.cc:348] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.701236 8354 raft_consensus.cc:2454] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:11.701823 8627 raft_consensus.cc:374] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.702112 8627 raft_consensus.cc:729] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.705452 9659 raft_consensus.cc:504] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.709372 8351 raft_consensus.cc:2379] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:11.709775 9697 raft_consensus.cc:482] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:11.709690 8636 raft_consensus.cc:348] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.710582 8636 raft_consensus.cc:374] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.711067 8636 raft_consensus.cc:729] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.710477 9697 raft_consensus.cc:504] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:11.703094 8627 consensus_queue.cc:260] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.715550 8353 raft_consensus.cc:2454] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:11.716398 9682 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:11.716514 9692 tablet.cc:1722] T e98e0f5b053649f1a5ab315312b37442 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:11.721777 9659 leader_election.cc:288] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:11.709379 8350 raft_consensus.cc:2454] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:11.724542 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d"
I20260812 19:27:11.725353 7802 raft_consensus.cc:2379] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in current term 2: Already voted for candidate fa34b607af684984bbfb5cd60a2f058d in this term.
I20260812 19:27:11.727983 9697 leader_election.cc:288] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:11.733407 9697 raft_consensus.cc:2726] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:11.736852 9425 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 2.
I20260812 19:27:11.737872 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 2 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6"
I20260812 19:27:11.733315 9690 raft_consensus.cc:482] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:11.738897 9690 raft_consensus.cc:504] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.742815 9690 leader_election.cc:288] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:11.712177 8636 consensus_queue.cc:260] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.754261 8278 leader_election.cc:302] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:11.755046 8509 raft_consensus.cc:3037] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:11.762146 8278 leader_election.cc:341] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:11.642666 8108 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:11.682605 8107 leader_election.cc:302] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
W20260812 19:27:11.765547 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 83035.4us
I20260812 19:27:11.766140 8107 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:11.766335 9700 consensus_queue.cc:1035] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:11.763814 9690 raft_consensus.cc:2726] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260812 19:27:11.764683 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 122067us
W20260812 19:27:11.771548 8108 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:11.777100 9682 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 election: Requested vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:11.783614 8627 ts_tablet_manager.cc:1428] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.124s user 0.014s sys 0.008s
I20260812 19:27:11.784756 8627 tablet_bootstrap.cc:492] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:11.788825 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 (table default.Table_df6e7bbfeab2475e99f37f8653d5e8e1 [id=c7693e18a1794f2391e8364b84c09f86]) successfully deleted
W20260812 19:27:11.801247 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 113857us
I20260812 19:27:11.802312 8281 leader_election.cc:302] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:11.807734 9282 raft_consensus.cc:482] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:11.808380 9282 raft_consensus.cc:504] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.811866 9282 leader_election.cc:288] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:11.773247 9616 raft_consensus.cc:2781] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:11.780779 9561 raft_consensus.cc:2781] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:11.816450 8636 ts_tablet_manager.cc:1428] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.164s user 0.007s sys 0.001s
I20260812 19:27:11.817669 8636 tablet_bootstrap.cc:492] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:11.818755 9699 raft_consensus.cc:2726] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:11.834481 8627 tablet_bootstrap.cc:654] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:11.835251 9616 raft_consensus.cc:686] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:11.840849 9616 consensus_queue.cc:237] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:11.849067 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 85658.7us
I20260812 19:27:11.852934 8443 leader_election.cc:302] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:11.852804 9632 catalog_manager.cc:1259] Loaded cluster ID: 659155adda434886ba3c3e41d37f31b5
I20260812 19:27:11.855867 9653 raft_consensus.cc:2726] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260812 19:27:11.852195 8110 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 194885us
I20260812 19:27:11.866156 8443 leader_election.cc:302] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:11.871743 9690 raft_consensus.cc:482] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:11.872545 9690 raft_consensus.cc:504] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:11.875434 8281 leader_election.cc:302] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:11.876336 9445 raft_consensus.cc:2781] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:11.864954 9482 tablet_replica.cc:330] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:11.877029 9445 raft_consensus.cc:686] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:11.878490 9445 consensus_queue.cc:237] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.879763 9699 consensus_queue.cc:1035] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260812 19:27:11.883342 9653 raft_consensus.cc:2781] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:11.884057 9653 raft_consensus.cc:686] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:11.869753 8509 raft_consensus.cc:2454] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:11.885690 9653 consensus_queue.cc:237] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.887259 9690 leader_election.cc:288] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:11.890141 9658 raft_consensus.cc:504] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:11.892542 7972 raft_consensus.cc:2354] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9a660a0f1e4fc6bc6335b38eece0bd for earlier term 2. Current term is 3.
I20260812 19:27:11.894543 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d"
I20260812 19:27:11.895128 7802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:11.896557 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "95e195a643084486a74be961177bf42c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:11.897243 8179 raft_consensus.cc:3037] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.898865 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:11.902796 9360 leader_election.cc:398] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 election: Vote denied by peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9a660a0f1e4fc6bc6335b38eece0bd for earlier term 2. Current term is 3.
I20260812 19:27:11.903276 9360 leader_election.cc:401] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260812 19:27:11.905659 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:11.906387 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:11.907379 8278 leader_election.cc:302] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:11.899832 8177 raft_consensus.cc:2454] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:11.900810 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:11.912060 8176 raft_consensus.cc:3037] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:11.913834 8627 tablet_bootstrap.cc:492] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:11.914467 8627 ts_tablet_manager.cc:1397] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.130s user 0.011s sys 0.010s
I20260812 19:27:11.918399 8627 raft_consensus.cc:348] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.919227 8627 raft_consensus.cc:374] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:11.919520 8627 raft_consensus.cc:729] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:11.920670 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:11.929358 8278 leader_election.cc:341] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:11.930088 8278 leader_election.cc:341] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:11.908633 9445 raft_consensus.cc:2781] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 19:27:11.939839 8443 leader_election.cc:341] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a84bf28a3e174f3b88f8758b09ced1f1
I20260812 19:27:11.943742 9445 raft_consensus.cc:686] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:11.942318 8627 consensus_queue.cc:260] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.949156 9682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:27:11.855938 9632 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: loading cluster ID for follower catalog manager: success
I20260812 19:27:11.956444 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:11.957439 8182 raft_consensus.cc:2454] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:11.945426 9445 consensus_queue.cc:237] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.964421 8627 ts_tablet_manager.cc:1428] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.050s user 0.005s sys 0.004s
I20260812 19:27:11.965523 8627 tablet_bootstrap.cc:492] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:11.971992 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:11.954579 8278 leader_election.cc:341] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:11.988341 9651 raft_consensus.cc:482] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:11.989275 9651 raft_consensus.cc:504] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:11.992209 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:12.001055 9651 leader_election.cc:288] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:12.009619 8281 leader_election.cc:302] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:27:12.010089 8278 leader_election.cc:341] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:12.011752 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 221541us
I20260812 19:27:12.016207 8281 leader_election.cc:302] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:27:12.017153 8108 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:12.022061 9654 raft_consensus.cc:2781] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.022775 9654 raft_consensus.cc:482] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.023550 9654 raft_consensus.cc:3037] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.023730 9670 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:33126 (request call id 289) took 2040 ms. Trace:
I20260812 19:27:12.024461 9690 raft_consensus.cc:482] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.025179 9690 raft_consensus.cc:504] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.029341 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:11.993362 8175 raft_consensus.cc:2454] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:12.028075 9617 raft_consensus.cc:2781] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.036864 9617 raft_consensus.cc:482] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.037549 9617 raft_consensus.cc:3037] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.016593 9482 raft_consensus.cc:2229] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:12.045956 9690 leader_election.cc:288] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:12.051925 9482 raft_consensus.cc:2258] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:12.073084 9705 raft_consensus.cc:482] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.073665 9705 raft_consensus.cc:504] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:12.078733 9654 raft_consensus.cc:504] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.076133 9705 leader_election.cc:288] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:12.084725 9654 leader_election.cc:288] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:12.088481 9617 raft_consensus.cc:504] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:12.090741 9617 leader_election.cc:288] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:11.940239 7802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 3.
I20260812 19:27:12.105332 8627 tablet_bootstrap.cc:654] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.024582 9670 rpcz_store.cc:276] 0812 19:27:09.983460 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.984490 (+ 1030us) service_pool.cc:227] Handling call
0812 19:27:12.023524 (+2039034us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:10.358086 (+ 0us) alter_schema_op.cc:102] PREPARE ALTER-SCHEMA: Starting
0812 19:27:10.360194 (+ 2108us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0812 19:27:10.360455 (+ 261us) alter_schema_op.cc:65] Acquired schema lock
0812 19:27:10.361130 (+ 675us) alter_schema_op.cc:117] PREPARE ALTER-SCHEMA: finished
0812 19:27:10.361234 (+ 104us) alter_schema_op.cc:126] START. Timestamp: 1786562830361172
0812 19:27:10.361294 (+ 60us) op_driver.cc:331] REPLICATION: starting
0812 19:27:10.553593 (+192299us) log.cc:842] Serialized 173 byte log entry
0812 19:27:11.017738 (+464145us) spinlock_profiling.cc:243] Waited 884 us on lock 0x7b540010fa20. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f98387f3771 00007f98387fe220 00007f98387fe1c8 00007f98387fe148 00007f98387fe103 00007f98387fd38c 00007f983a7e8206 00007f983a7e0808 00007f983883a38b 00007f983883ce80
0812 19:27:11.365096 (+347358us) op_driver.cc:444] REPLICATION: finished
0812 19:27:11.430727 (+ 65631us) alter_schema_op.cc:131] APPLY ALTER-SCHEMA: Starting
0812 19:27:11.433965 (+ 3238us) log.cc:842] Serialized 5 byte log entry
0812 19:27:11.869691 (+435726us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:11.871977 (+ 2286us) log.cc:842] Serialized 14 byte log entry
0812 19:27:11.994114 (+122137us) alter_schema_op.cc:71] Released schema lock
0812 19:27:12.009320 (+ 15206us) alter_schema_op.cc:184] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":64829,"prepare.queue_time_us":372564,"prepare.run_cpu_time_us":19249,"prepare.run_wall_time_us":630698,"raft.queue_time_us":15638,"raft.run_cpu_time_us":38,"raft.run_wall_time_us":12744,"replication_time_us":1003643,"spinlock_wait_cycles":2033536,"thread_start_us":656441,"threads_started":3,"wal-append.queue_time_us":412277}]]}
W20260812 19:27:12.130371 9694 log.cc:924] Time spent T c6075b2e46524829962d2b84353013b2 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.296s user 0.004s sys 0.000s
I20260812 19:27:12.151274 9401 ts_manager.cc:194] Registered new tserver with Master: 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:12.157388 7948 leader_election.cc:302] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d; no voters:
I20260812 19:27:12.171360 7747 master-stress-test.cc:578] Killing test thread 1/10
I20260812 19:27:12.173166 8512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:12.173168 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:12.175004 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:12.176299 8278 leader_election.cc:341] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:12.177791 8278 leader_election.cc:341] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.178431 8636 tablet_bootstrap.cc:654] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.178629 9730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 FOLLOWER]: Leader election won for term 3
W20260812 19:27:12.179499 8278 leader_election.cc:341] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.163996 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:12.181766 8278 leader_election.cc:341] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.184126 9730 raft_consensus.cc:686] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 LEADER]: Becoming Leader. State: Replica: b99a815f68ee4d93b167a67778a3e1a6, State: Running, Role: LEADER
I20260812 19:27:12.186163 8627 tablet_bootstrap.cc:492] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:12.186699 8627 ts_tablet_manager.cc:1397] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.221s user 0.013s sys 0.012s
I20260812 19:27:12.191155 8627 raft_consensus.cc:348] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.196781 9730 consensus_queue.cc:237] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 316, Committed index: 316, Last appended: 1.317, Last appended by leader: 317, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:12.198339 8627 raft_consensus.cc:374] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.198642 8627 raft_consensus.cc:729] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.087862 9561 raft_consensus.cc:686] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
W20260812 19:27:12.152534 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 131296us
I20260812 19:27:12.210884 8179 raft_consensus.cc:2454] T 95e195a643084486a74be961177bf42c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:12.219142 8627 consensus_queue.cc:260] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.222095 8627 ts_tablet_manager.cc:1428] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.035s user 0.006s sys 0.004s
I20260812 19:27:12.230767 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 3 candidate_status { last_received { term: 1 index: 317 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
I20260812 19:27:12.231645 9658 leader_election.cc:288] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 3 election: Requested vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563)
I20260812 19:27:12.235749 9732 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 3 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:12.236861 9732 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
W20260812 19:27:12.272473 9717 log.cc:924] Time spent T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.063s user 0.001s sys 0.000s
I20260812 19:27:12.291918 8627 tablet_bootstrap.cc:492] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:12.298158 8627 tablet_bootstrap.cc:654] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.303050 9653 raft_consensus.cc:482] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.304107 9653 raft_consensus.cc:504] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.306504 9561 consensus_queue.cc:237] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:12.310141 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 92214.7us
I20260812 19:27:12.314872 8108 leader_election.cc:302] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:12.318291 9703 raft_consensus.cc:2781] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.318764 9703 raft_consensus.cc:686] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:12.319548 9703 consensus_queue.cc:237] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.321596 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:12.323391 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:12.324025 8179 raft_consensus.cc:3037] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.327756 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:12.327922 8443 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 863e7ca808f54a989b3372aa4bfe361e
I20260812 19:27:12.336304 8179 raft_consensus.cc:2454] T 968eb13e27ea4f93a45aad17110b0ee4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:12.337317 8281 leader_election.cc:302] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:12.338124 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:12.338486 9445 raft_consensus.cc:2781] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.338828 8178 raft_consensus.cc:3037] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.339038 9445 raft_consensus.cc:482] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.339543 9445 raft_consensus.cc:3037] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.344506 8623 tablet_bootstrap.cc:492] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:12.345152 8623 ts_tablet_manager.cc:1397] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 1.130s user 0.014s sys 0.008s
I20260812 19:27:12.345324 8636 tablet_bootstrap.cc:492] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:12.287035 8176 raft_consensus.cc:2454] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:12.345916 8636 ts_tablet_manager.cc:1397] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.529s user 0.015s sys 0.006s
I20260812 19:27:12.347013 8108 leader_election.cc:302] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:12.330596 9667 consensus_meta.cc:287] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.901s user 0.009s sys 0.004s
I20260812 19:27:12.353924 9653 leader_election.cc:288] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:12.357816 8281 leader_election.cc:341] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.358383 8281 leader_election.cc:302] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:27:12.359604 8281 leader_election.cc:341] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.360448 9659 raft_consensus.cc:2726] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:12.359917 8281 leader_election.cc:302] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:12.365141 8281 leader_election.cc:302] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:12.365688 9654 raft_consensus.cc:2726] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:12.368572 9617 raft_consensus.cc:2781] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.369306 9617 raft_consensus.cc:686] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:12.370321 8108 leader_election.cc:302] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:12.376727 9617 consensus_queue.cc:237] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.390502 9482 ts_tablet_manager.cc:1905] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:12.396883 8281 leader_election.cc:302] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:12.398520 9654 raft_consensus.cc:2781] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.399667 9654 raft_consensus.cc:686] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:12.401304 9654 consensus_queue.cc:237] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.402038 9682 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815) with higher term. Message: Invalid argument: T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9a660a0f1e4fc6bc6335b38eece0bd for earlier term 2. Current term is 3.
I20260812 19:27:12.415715 9425 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 3.
I20260812 19:27:12.391027 9616 raft_consensus.cc:2726] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:12.385067 9667 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.426741 8636 raft_consensus.cc:348] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.427521 8636 raft_consensus.cc:374] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.427769 8636 raft_consensus.cc:729] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.407976 9445 raft_consensus.cc:504] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:12.430877 9445 leader_election.cc:288] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:12.433153 8243 heartbeater.cc:464] Registering TS with master...
I20260812 19:27:12.438309 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:12.439684 8278 leader_election.cc:341] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.440776 9617 consensus_queue.cc:1035] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:12.445182 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:12.445845 8176 raft_consensus.cc:3037] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.454748 8627 tablet_bootstrap.cc:492] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:12.455193 8627 ts_tablet_manager.cc:1397] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.163s user 0.027s sys 0.030s
I20260812 19:27:12.458457 8627 raft_consensus.cc:348] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.459271 8627 raft_consensus.cc:374] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.458841 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3740799e07f94fe981d395ef8c3d7973" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:12.459574 8627 raft_consensus.cc:729] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.459987 8511 raft_consensus.cc:3037] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 2
I20260812 19:27:12.460450 8627 consensus_queue.cc:260] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.463312 8627 ts_tablet_manager.cc:1428] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.008s user 0.003s sys 0.003s
I20260812 19:27:12.464617 8627 tablet_bootstrap.cc:492] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:12.465049 8176 raft_consensus.cc:2454] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:12.466146 8281 leader_election.cc:302] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:12.467281 9445 raft_consensus.cc:2781] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.470659 8623 raft_consensus.cc:348] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:12.471400 8623 raft_consensus.cc:374] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:12.471694 8623 raft_consensus.cc:729] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:12.472527 9653 consensus_queue.cc:1035] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:12.474699 9617 consensus_queue.cc:1035] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:12.468410 9445 raft_consensus.cc:686] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:12.490736 9445 consensus_queue.cc:237] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:12.428452 8636 consensus_queue.cc:260] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.510291 8636 ts_tablet_manager.cc:1428] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.164s user 0.007s sys 0.000s
I20260812 19:27:12.511185 8636 tablet_bootstrap.cc:492] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:12.543499 9747 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.558961 8623 consensus_queue.cc:260] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:12.561568 8623 ts_tablet_manager.cc:1428] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.216s user 0.006s sys 0.000s
W20260812 19:27:12.491904 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 121830us
I20260812 19:27:12.492502 9616 raft_consensus.cc:2781] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:12.572860 9616 raft_consensus.cc:686] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:12.574455 9616 consensus_queue.cc:237] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.472807 9667 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:12.580737 9747 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
W20260812 19:27:12.596354 9739 log.cc:924] Time spent T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.209s user 0.000s sys 0.002s
I20260812 19:27:12.618798 9425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 1 index: 316 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:12.619856 9425 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa34b607af684984bbfb5cd60a2f058d for term 4 because replica has last-logged OpId of term: 1 index: 317, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 316.
I20260812 19:27:12.630560 8627 tablet_bootstrap.cc:654] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:12.638118 9747 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:12.638520 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 1 index: 316 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:12.639987 8623 tablet_bootstrap.cc:492] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:12.640872 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:12.655912 9702 raft_consensus.cc:482] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.657208 9702 raft_consensus.cc:504] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.660866 9702 leader_election.cc:288] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:12.665510 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:12.673092 8107 leader_election.cc:341] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.675212 8511 raft_consensus.cc:2454] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 2.
I20260812 19:27:12.677007 8107 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:12.678866 9710 raft_consensus.cc:2781] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:12.679564 9710 raft_consensus.cc:686] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:12.681833 9710 consensus_queue.cc:237] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.693461 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:12.694461 8176 raft_consensus.cc:2454] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:12.709956 7802 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Refusing update from remote peer b99a815f68ee4d93b167a67778a3e1a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 316. Preceding OpId from leader: term: 3 index: 318. (index mismatch)
I20260812 19:27:12.711760 9732 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 318, Last known committed idx: 316, Time since last communication: 0.001s
I20260812 19:27:12.716482 8636 tablet_bootstrap.cc:654] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:12.722894 7945 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet df369d3c4e004c29ac65c5ecf7f8c4cc (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet df369d3c4e004c29ac65c5ecf7f8c4cc consensus state has no leader
I20260812 19:27:12.677901 9445 raft_consensus.cc:482] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.734949 9445 raft_consensus.cc:504] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.737002 9445 leader_election.cc:288] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:12.678579 9690 raft_consensus.cc:482] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.737547 9690 raft_consensus.cc:504] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.738034 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdb7cce923c4ed98e400c121b6237ba" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:12.739305 8281 leader_election.cc:341] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.739533 9690 leader_election.cc:288] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:12.741122 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:12.742139 8176 raft_consensus.cc:2454] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:12.742240 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:12.743481 8281 leader_election.cc:302] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:12.744390 9690 raft_consensus.cc:2781] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:12.744772 9690 raft_consensus.cc:482] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:12.745167 9690 raft_consensus.cc:3037] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:12.748452 9445 consensus_queue.cc:1035] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:12.750670 9632 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: acquiring CA information for follower catalog manager: success
I20260812 19:27:12.764344 9617 consensus_queue.cc:1035] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:27:12.766196 8278 leader_election.cc:341] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:12.780458 9445 consensus_queue.cc:1035] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:12.791486 9667 consensus_queue.cc:1035] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:12.805830 9425 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Refusing update from remote peer b99a815f68ee4d93b167a67778a3e1a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 317. Preceding OpId from leader: term: 3 index: 318. (index mismatch)
I20260812 19:27:12.808046 9732 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 318, Last known committed idx: 316, Time since last communication: 0.001s
I20260812 19:27:12.815181 9682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 3 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:12.816450 9682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:12.825302 9682 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:12.826187 9682 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:12.842751 9732 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:12.843672 9732 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
I20260812 19:27:12.845232 9746 raft_consensus.cc:482] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:12.845697 9746 raft_consensus.cc:504] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:12.795823 8136 rpcz_store.cc:275] Call kudu.tserver.TabletServerService.ListTablets from 127.0.0.1:33112 (request call id 27) took 2380 ms. Trace:
I20260812 19:27:12.887223 8136 rpcz_store.cc:276] 0812 19:27:10.419717 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:10.539708 (+119991us) service_pool.cc:227] Handling call
0812 19:27:12.300559 (+1760851us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54000d48d4. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f983885f268 00007f983984b6cd 00007f98380f3e04 00007f98380f3d92 00007f98380f3cc1 00007f98380f3c3c 00007f98380f2ef2 00007f983662094c 00007f983661fd86 00007f983661f72f
0812 19:27:12.318768 (+ 18209us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b5400112454. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f983885f268 00007f983984b6cd 00007f98380f3e04 00007f98380f3d92 00007f98380f3cc1 00007f98380f3c3c 00007f98380f2ef2 00007f983662094c 00007f983661fd86 00007f983661f72f
0812 19:27:12.481326 (+162558us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54000b2f54. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f983885f268 00007f983984b6cd 00007f98380f3e04 00007f98380f3d92 00007f98380f3cc1 00007f98380f3c3c 00007f98380f2ef2 00007f983662094c 00007f983661fd86 00007f983661f72f
0812 19:27:12.520715 (+ 39389us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b54000b2554. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f983885f268 00007f983984b6cd 00007f98380f3e04 00007f98380f3d92 00007f98380f3cc1 00007f98380f3c3c 00007f98380f2ef2 00007f983662094c 00007f983661fd86 00007f983661f72f
0812 19:27:12.794697 (+273982us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1559166464}
I20260812 19:27:12.889813 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_c2e56d6bab7a4ae9aeb5725ac10e4c50 [id=525ff469b92d436fba5e9319b7ddb9fc]). Expected version 1 got 0
I20260812 19:27:12.890794 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]). Expected version 1 got 0
I20260812 19:27:12.893214 8145 tablet_service.cc:1467] Processing CreateTablet for tablet 7c258a18b8da47aabafd67023d3e5812 (DEFAULT_TABLE table=default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.894529 8145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c258a18b8da47aabafd67023d3e5812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.896713 8149 tablet_service.cc:1467] Processing CreateTablet for tablet c881ad61438d4a978e3c479aefcfa4cb (DEFAULT_TABLE table=default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.898080 8149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c881ad61438d4a978e3c479aefcfa4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.896477 7954 catalog_manager.cc:5495] T a06d3ff29cc14599bce1531a7b63f072 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:12.907636 9402 ts_manager.cc:194] Registered new tserver with Master: 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:12.909238 7954 catalog_manager.cc:5495] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:12.913964 8147 tablet_service.cc:1467] Processing CreateTablet for tablet f9aa94ea25c04790902a3a4d0c0099ad (DEFAULT_TABLE table=default.Table_a059cc3e3a9345ddbd2e7c031966470f [id=a095e4d6dde54adfbd59686c9e67d995]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.915364 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9aa94ea25c04790902a3a4d0c0099ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.869910 8146 tablet_service.cc:1467] Processing CreateTablet for tablet d30c274273c3496cb0a8b8650b504250 (DEFAULT_TABLE table=default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.930392 8146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30c274273c3496cb0a8b8650b504250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.931558 7954 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet f7c9e6328b70417cbeecf31f318f9b61 (table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]). Expected version 1 got 0
I20260812 19:27:12.937664 7962 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 04d56a12f8964d4a9ccbc5f870b89713
I20260812 19:27:12.939366 7962 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 257) took 7294 ms. Trace:
I20260812 19:27:12.884610 8153 tablet_service.cc:1467] Processing CreateTablet for tablet 7a530a6bcdb04b268c7a3f4becb065e2 (DEFAULT_TABLE table=default.Table_bcd87c04648c489e9d444bbc8470ccd7 [id=95e83940f5bc4baeba825114eadde1a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.941659 8153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a530a6bcdb04b268c7a3f4becb065e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.941692 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d56a12f8964d4a9ccbc5f870b89713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:06 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:12.879772 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:12.948550 7957 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 94407c13a91c4a76bd3aa1c1c8032384
I20260812 19:27:12.826395 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7c9e6328b70417cbeecf31f318f9b61" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:12.949956 7957 rpcz_store.cc:275] Call kudu.master.MasterService.DeleteTable from 127.0.0.1:46888 (request call id 262) took 6778 ms. Trace:
I20260812 19:27:12.939728 7962 rpcz_store.cc:276] 0812 19:27:05.645429 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.760994 (+1115565us) service_pool.cc:227] Handling call
0812 19:27:06.934242 (+173248us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eaf466 00007f05ee9f0b34 00007f05ee9f0ac2 00007f05ee9f09f1 00007f05ee9f096c 00007f05ee9efc22 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:06.966930 (+ 32688us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:06.988417 (+ 21487us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:27:06.989719 (+ 1302us) catalog_manager.cc:2761] Locking tablets
0812 19:27:08.413518 (+1423799us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:27:09.001316 (+587798us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:27:09.001568 (+ 252us) catalog_manager.cc:2809] Committing in-memory state
0812 19:27:12.937561 (+3935993us) catalog_manager.cc:2813] Aborting table tasks
0812 19:27:12.939276 (+ 1715us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:08.977637 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:08.978846 (+ 1209us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:08.978883 (+ 37us) write_op.cc:435] Acquired schema lock
0812 19:27:08.978901 (+ 18us) tablet.cc:660] Decoding operations
0812 19:27:08.979596 (+ 695us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:08.979673 (+ 77us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:08.979716 (+ 43us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:08.980570 (+ 854us) tablet.cc:699] Row locks acquired
0812 19:27:08.980604 (+ 34us) write_op.cc:260] PREPARE: finished
0812 19:27:08.980794 (+ 190us) write_op.cc:270] Start()
0812 19:27:08.981254 (+ 460us) write_op.cc:276] Timestamp: P: 1786562828980690 usec, L: 0
0812 19:27:08.981304 (+ 50us) op_driver.cc:331] REPLICATION: starting
0812 19:27:08.982266 (+ 962us) log.cc:842] Serialized 731 byte log entry
0812 19:27:08.997023 (+ 14757us) op_driver.cc:444] REPLICATION: finished
0812 19:27:08.997930 (+ 907us) write_op.cc:301] APPLY: starting
0812 19:27:08.998023 (+ 93us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:08.998207 (+ 184us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:08.998390 (+ 183us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:08.998930 (+ 540us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:08.999136 (+ 206us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:08.999298 (+ 162us) write_op.cc:312] APPLY: finished
0812 19:27:08.999719 (+ 421us) log.cc:842] Serialized 29 byte log entry
0812 19:27:08.999962 (+ 243us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.000099 (+ 137us) write_op.cc:454] Released schema lock
0812 19:27:09.000183 (+ 84us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:09.002582 (+ 2399us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.002613 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":267465088,"child_traces":[["op",{"apply.queue_time_us":632,"apply.run_cpu_time_us":2802,"apply.run_wall_time_us":4903,"num_ops":2,"prepare.queue_time_us":561802,"prepare.run_cpu_time_us":4024,"prepare.run_wall_time_us":334490,"raft.queue_time_us":451,"raft.run_cpu_time_us":1273,"raft.run_wall_time_us":12275,"replication_time_us":15584}]]}
I20260812 19:27:12.953663 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 94407c13a91c4a76bd3aa1c1c8032384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:07 UTC) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:12.955106 7962 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 43) took 3198 ms (client timeout 1000 ms). Trace:
W20260812 19:27:12.958097 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 42) took 4218 ms (client timeout 1000 ms). Trace:
W20260812 19:27:12.958418 7960 rpcz_store.cc:269] 0812 19:27:08.739737 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.909143 (+169406us) service_pool.cc:227] Handling call
0812 19:27:08.950962 (+ 41819us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:12.958033 (+4007071us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":9,"spinlock_wait_cycles":88447744}
W20260812 19:27:12.966387 8178 consensus_meta.cc:287] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent flushing consensus metadata: real 0.582s user 0.006s sys 0.006s
I20260812 19:27:12.966835 8178 raft_consensus.cc:2454] T f57f252b520945328fdaaa9adef593a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:12.975548 8154 tablet_service.cc:1467] Processing CreateTablet for tablet cc0601e681ba426991b22b6a7303ae2c (DEFAULT_TABLE table=default.Table_b25383bb16404fac95cc1d79e20e1185 [id=ed6829a78ccb41109d1f99403f38ddb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.976923 8154 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc0601e681ba426991b22b6a7303ae2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.999866 8623 tablet_bootstrap.cc:654] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:13.011257 7960 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 42) took 2102 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.011708 7960 rpcz_store.cc:269] 0812 19:27:10.908846 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.011087 (+2102241us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:13.011186 (+ 99us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:12.956591 7962 rpcz_store.cc:269] 0812 19:27:09.756244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:12.954815 (+3198571us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:12.955027 (+ 212us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:12.950223 7957 rpcz_store.cc:276] 0812 19:27:06.171934 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.209306 (+1037372us) service_pool.cc:227] Handling call
0812 19:27:07.210842 (+ 1536us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:07.263113 (+ 52271us) catalog_manager.cc:2752] Modifying in-memory table state
0812 19:27:07.263323 (+ 210us) catalog_manager.cc:2761] Locking tablets
0812 19:27:08.416389 (+1153066us) catalog_manager.cc:2775] Removing table and tablets from system table
0812 19:27:09.415459 (+999070us) catalog_manager.cc:2793] Removing table from by-name map
0812 19:27:09.415702 (+ 243us) catalog_manager.cc:2809] Committing in-memory state
0812 19:27:12.948457 (+3532755us) catalog_manager.cc:2813] Aborting table tasks
0812 19:27:12.949904 (+ 1447us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:09.312419 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:09.322887 (+ 10468us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:09.322940 (+ 53us) write_op.cc:435] Acquired schema lock
0812 19:27:09.322986 (+ 46us) tablet.cc:660] Decoding operations
0812 19:27:09.324587 (+ 1601us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:09.324638 (+ 51us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:09.399619 (+ 74981us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:09.400168 (+ 549us) tablet.cc:699] Row locks acquired
0812 19:27:09.400204 (+ 36us) write_op.cc:260] PREPARE: finished
0812 19:27:09.400446 (+ 242us) write_op.cc:270] Start()
0812 19:27:09.400717 (+ 271us) write_op.cc:276] Timestamp: P: 1786562829400342 usec, L: 0
0812 19:27:09.400754 (+ 37us) op_driver.cc:331] REPLICATION: starting
0812 19:27:09.401864 (+ 1110us) log.cc:842] Serialized 731 byte log entry
0812 19:27:09.412171 (+ 10307us) op_driver.cc:444] REPLICATION: finished
0812 19:27:09.412981 (+ 810us) write_op.cc:301] APPLY: starting
0812 19:27:09.413058 (+ 77us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:09.413199 (+ 141us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:09.413308 (+ 109us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:09.413728 (+ 420us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:09.413976 (+ 248us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:09.414059 (+ 83us) write_op.cc:312] APPLY: finished
0812 19:27:09.414466 (+ 407us) log.cc:842] Serialized 29 byte log entry
0812 19:27:09.414649 (+ 183us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.414720 (+ 71us) write_op.cc:454] Released schema lock
0812 19:27:09.414756 (+ 36us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:09.414964 (+ 208us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.415002 (+ 38us) write_op.cc:454] Released schema lock
Metrics: {"child_traces":[["op",{"apply.queue_time_us":582,"apply.run_cpu_time_us":2259,"apply.run_wall_time_us":2259,"num_ops":2,"prepare.queue_time_us":893952,"prepare.run_cpu_time_us":4321,"prepare.run_wall_time_us":158287,"raft.queue_time_us":117,"raft.run_cpu_time_us":1058,"raft.run_wall_time_us":1058,"replication_time_us":11306}]]}
I20260812 19:27:12.936677 7955 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0] alter complete (version 2)
W20260812 19:27:12.972142 7956 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet c6075b2e46524829962d2b84353013b2 consensus state has no leader
I20260812 19:27:13.014087 7956 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 264) took 5821 ms. Trace:
W20260812 19:27:13.016851 7957 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 44) took 2035 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.017264 7957 rpcz_store.cc:269] 0812 19:27:10.981668 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.016683 (+2035015us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:13.016801 (+ 118us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:13.027676 7957 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 45) took 771 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.028677 8108 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:12.945691 8482 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d56a12f8964d4a9ccbc5f870b89713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:06 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:12.849131 9651 consensus_queue.cc:1035] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.208s
I20260812 19:27:12.880882 8491 tablet_service.cc:1467] Processing CreateTablet for tablet d30c274273c3496cb0a8b8650b504250 (DEFAULT_TABLE table=default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.058529 8491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30c274273c3496cb0a8b8650b504250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.894284 8484 tablet_service.cc:1467] Processing CreateTablet for tablet 7a530a6bcdb04b268c7a3f4becb065e2 (DEFAULT_TABLE table=default.Table_bcd87c04648c489e9d444bbc8470ccd7 [id=95e83940f5bc4baeba825114eadde1a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.897490 8492 tablet_service.cc:1467] Processing CreateTablet for tablet c881ad61438d4a978e3c479aefcfa4cb (DEFAULT_TABLE table=default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.906620 8488 tablet_service.cc:1467] Processing CreateTablet for tablet f9aa94ea25c04790902a3a4d0c0099ad (DEFAULT_TABLE table=default.Table_a059cc3e3a9345ddbd2e7c031966470f [id=a095e4d6dde54adfbd59686c9e67d995]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.894930 8481 tablet_service.cc:1467] Processing CreateTablet for tablet 7c258a18b8da47aabafd67023d3e5812 (DEFAULT_TABLE table=default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.932312 8479 tablet_service.cc:1467] Processing CreateTablet for tablet cc0601e681ba426991b22b6a7303ae2c (DEFAULT_TABLE table=default.Table_b25383bb16404fac95cc1d79e20e1185 [id=ed6829a78ccb41109d1f99403f38ddb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:12.853223 9746 leader_election.cc:288] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:13.063817 8484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a530a6bcdb04b268c7a3f4becb065e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.928783 9653 raft_consensus.cc:482] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:13.072947 9653 raft_consensus.cc:504] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.072554 8492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c881ad61438d4a978e3c479aefcfa4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.036228 8485 tablet_service.cc:1514] Processing DeleteTablet for tablet 94407c13a91c4a76bd3aa1c1c8032384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:07 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:13.091109 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9aa94ea25c04790902a3a4d0c0099ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:12.851773 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdb7cce923c4ed98e400c121b6237ba" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:13.014376 7956 rpcz_store.cc:276] 0812 19:27:07.192944 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.257005 (+ 64061us) service_pool.cc:227] Handling call
0812 19:27:07.258298 (+ 1293us) catalog_manager.cc:2347] Looking up, locking, and authorizing table
0812 19:27:07.274150 (+ 15852us) catalog_manager.cc:3616] Apply alter schema
0812 19:27:07.276686 (+ 2536us) catalog_manager.cc:3639] Acquired catalog manager lock
0812 19:27:07.276917 (+ 231us) catalog_manager.cc:3786] Updating metadata on disk
0812 19:27:07.686914 (+409997us) catalog_manager.cc:3817] Committing alterations to in-memory state
0812 19:27:13.014012 (+5327098us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:07.514496 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:07.515635 (+ 1139us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:07.515702 (+ 67us) write_op.cc:435] Acquired schema lock
0812 19:27:07.515744 (+ 42us) tablet.cc:660] Decoding operations
0812 19:27:07.579504 (+ 63760us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:07.579636 (+ 132us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:07.579699 (+ 63us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:07.580172 (+ 473us) tablet.cc:699] Row locks acquired
0812 19:27:07.580197 (+ 25us) write_op.cc:260] PREPARE: finished
0812 19:27:07.580677 (+ 480us) write_op.cc:270] Start()
0812 19:27:07.580911 (+ 234us) write_op.cc:276] Timestamp: P: 1786562827580428 usec, L: 0
0812 19:27:07.580969 (+ 58us) op_driver.cc:331] REPLICATION: starting
0812 19:27:07.654371 (+ 73402us) log.cc:842] Serialized 405 byte log entry
0812 19:27:07.660498 (+ 6127us) spinlock_profiling.cc:243] Waited 71.3 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64471 00007f05eeedb198 00007f05ef33cade 00007f05ef33c2b8 00007f05ef340ba1 00007f05ef340b59 00007f05ef340ae9 00007f05ef340ab1 00007f05ef33fdad 0000000000580784 00000000005805b9
0812 19:27:07.675630 (+ 15132us) op_driver.cc:444] REPLICATION: finished
0812 19:27:07.685108 (+ 9478us) write_op.cc:301] APPLY: starting
0812 19:27:07.685197 (+ 89us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:07.685335 (+ 138us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:07.685366 (+ 31us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:07.685692 (+ 326us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:07.685939 (+ 247us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:07.686005 (+ 66us) write_op.cc:312] APPLY: finished
0812 19:27:07.686271 (+ 266us) log.cc:842] Serialized 23 byte log entry
0812 19:27:07.686472 (+ 201us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.686566 (+ 94us) write_op.cc:454] Released schema lock
0812 19:27:07.686607 (+ 41us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:07.687243 (+ 636us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.687274 (+ 31us) write_op.cc:454] Released schema lock
Metrics: {"spinlock_wait_cycles":53504,"child_traces":[["op",{"apply.queue_time_us":8424,"apply.run_cpu_time_us":2088,"apply.run_wall_time_us":3076,"mutex_wait_us":11708,"num_ops":1,"prepare.queue_time_us":236023,"prepare.run_cpu_time_us":8968,"prepare.run_wall_time_us":182623,"raft.queue_time_us":1097,"raft.run_cpu_time_us":1697,"raft.run_wall_time_us":33543,"replication_time_us":94528,"spinlock_wait_cycles":163876224}]]}
I20260812 19:27:13.095609 7956 master_service.cc:946] ReplaceTablet: received request to replace tablet 354d9912acad4c1ba76f45ce277f1e94 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:13.096305 7956 rpcz_store.cc:275] Call kudu.master.MasterService.ReplaceTablet from 127.0.0.1:46888 (request call id 272) took 4853 ms. Trace:
I20260812 19:27:13.096686 7956 rpcz_store.cc:276] 0812 19:27:08.243205 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.095493 (+4852288us) service_pool.cc:227] Handling call
0812 19:27:13.096213 (+ 720us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:13.098320 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 68854us
W20260812 19:27:13.106256 8581 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.144.252:46815)
W20260812 19:27:13.005625 7952 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 38) took 6205 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.115073 7952 rpcz_store.cc:269] 0812 19:27:06.800465 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.937230 (+136765us) service_pool.cc:227] Handling call
0812 19:27:13.005547 (+6068317us) inbound_call.cc:173] Queueing success response
Metrics: {"reported_tablets":23}
I20260812 19:27:13.116580 7952 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 274) took 4761 ms. Trace:
I20260812 19:27:13.118391 7952 rpcz_store.cc:276] 0812 19:27:08.355377 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.115959 (+4760582us) service_pool.cc:227] Handling call
0812 19:27:13.116512 (+ 553us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:13.027491 7955 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.195:34285 (request call id 41) took 5782 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.120311 7955 rpcz_store.cc:269] 0812 19:27:07.244775 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:07.246822 (+ 2047us) service_pool.cc:227] Handling call
0812 19:27:13.027406 (+5780584us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:07.697518 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:07.747003 (+ 49485us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:07.747078 (+ 75us) write_op.cc:435] Acquired schema lock
0812 19:27:07.747136 (+ 58us) tablet.cc:660] Decoding operations
0812 19:27:07.747734 (+ 598us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:07.747853 (+ 119us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:07.747918 (+ 65us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:07.748729 (+ 811us) tablet.cc:699] Row locks acquired
0812 19:27:07.748743 (+ 14us) write_op.cc:260] PREPARE: finished
0812 19:27:07.748983 (+ 240us) write_op.cc:270] Start()
0812 19:27:07.756680 (+ 7697us) write_op.cc:276] Timestamp: P: 1786562827748865 usec, L: 0
0812 19:27:07.756707 (+ 27us) op_driver.cc:331] REPLICATION: starting
0812 19:27:07.757875 (+ 1168us) log.cc:842] Serialized 356 byte log entry
0812 19:27:07.772986 (+ 15111us) op_driver.cc:444] REPLICATION: finished
0812 19:27:07.774366 (+ 1380us) write_op.cc:301] APPLY: starting
0812 19:27:07.774430 (+ 64us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:07.774575 (+ 145us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:07.774748 (+ 173us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:07.775089 (+ 341us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:07.775359 (+ 270us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:07.775432 (+ 73us) write_op.cc:312] APPLY: finished
0812 19:27:07.775770 (+ 338us) log.cc:842] Serialized 23 byte log entry
0812 19:27:07.776029 (+ 259us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.776118 (+ 89us) write_op.cc:454] Released schema lock
0812 19:27:07.776176 (+ 58us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:07.783854 (+ 7678us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:07.783917 (+ 63us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31311,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":1146,"apply.run_cpu_time_us":2628,"apply.run_wall_time_us":9783,"num_ops":1,"prepare.queue_time_us":405960,"prepare.run_cpu_time_us":4507,"prepare.run_wall_time_us":102564,"raft.queue_time_us":117,"raft.run_cpu_time_us":1523,"raft.run_wall_time_us":21697,"replication_time_us":16140}]]}
I20260812 19:27:13.123889 7955 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 275) took 4676 ms. Trace:
I20260812 19:27:13.124249 7955 rpcz_store.cc:276] 0812 19:27:08.447317 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.123255 (+4675938us) service_pool.cc:227] Handling call
0812 19:27:13.123827 (+ 572us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:13.126211 7955 rpcz_store.cc:275] Call kudu.master.MasterService.AlterTable from 127.0.0.1:46888 (request call id 276) took 4348 ms. Trace:
I20260812 19:27:13.126788 7955 rpcz_store.cc:276] 0812 19:27:08.777791 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.125742 (+4347951us) service_pool.cc:227] Handling call
0812 19:27:13.126135 (+ 393us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:13.128178 7955 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 277) took 4013 ms. Trace:
I20260812 19:27:13.129150 7955 rpcz_store.cc:276] 0812 19:27:09.115208 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.127656 (+4012448us) service_pool.cc:227] Handling call
0812 19:27:13.128132 (+ 476us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:13.131973 8581 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.144.252:46815)
W20260812 19:27:13.127175 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 55116.3us
W20260812 19:27:13.133353 8581 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.144.252:46815)
I20260812 19:27:13.133395 8147 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d660422701a423794416b01cea825b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ff5b2d23d734217b0b10e50834b8883) from {username='slave'} at 127.0.0.1:33126
W20260812 19:27:12.994266 7958 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 40) took 4926 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.134469 7958 rpcz_store.cc:269] 0812 19:27:08.068065 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.083157 (+ 15092us) service_pool.cc:227] Handling call
0812 19:27:08.102395 (+ 19238us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:12.994187 (+4891792us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:09.534981 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:09.535418 (+ 437us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:09.535449 (+ 31us) write_op.cc:435] Acquired schema lock
0812 19:27:09.535465 (+ 16us) tablet.cc:660] Decoding operations
0812 19:27:09.535743 (+ 278us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:09.535864 (+ 121us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:09.535896 (+ 32us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:09.536056 (+ 160us) tablet.cc:699] Row locks acquired
0812 19:27:09.536073 (+ 17us) write_op.cc:260] PREPARE: finished
0812 19:27:09.536190 (+ 117us) write_op.cc:270] Start()
0812 19:27:09.536308 (+ 118us) write_op.cc:276] Timestamp: P: 1786562829536108 usec, L: 0
0812 19:27:09.536345 (+ 37us) op_driver.cc:331] REPLICATION: starting
0812 19:27:09.537033 (+ 688us) log.cc:842] Serialized 533 byte log entry
0812 19:27:09.547472 (+ 10439us) op_driver.cc:444] REPLICATION: finished
0812 19:27:09.547827 (+ 355us) write_op.cc:301] APPLY: starting
0812 19:27:09.547883 (+ 56us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:09.547981 (+ 98us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:09.548071 (+ 90us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:09.548232 (+ 161us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:09.548393 (+ 161us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:09.548434 (+ 41us) write_op.cc:312] APPLY: finished
0812 19:27:09.548602 (+ 168us) log.cc:842] Serialized 23 byte log entry
0812 19:27:09.548735 (+ 133us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.548796 (+ 61us) write_op.cc:454] Released schema lock
0812 19:27:09.548825 (+ 29us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:09.548986 (+ 161us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:09.549008 (+ 22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69613,"reported_tablets":24,"spinlock_wait_cycles":33613184,"child_traces":[["op",{"apply.queue_time_us":215,"apply.run_cpu_time_us":1323,"apply.run_wall_time_us":1324,"num_ops":1,"prepare.queue_time_us":834064,"prepare.run_cpu_time_us":2414,"prepare.run_wall_time_us":115761,"raft.queue_time_us":88,"raft.run_cpu_time_us":662,"raft.run_wall_time_us":662,"replication_time_us":11047}]]}
I20260812 19:27:13.137157 8147 tablet_service.cc:1467] Processing CreateTablet for tablet aff8c4a6f27c499eb555d97017cb3a4c (DEFAULT_TABLE table=default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.138245 8147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff8c4a6f27c499eb555d97017cb3a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.099159 7956 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:46888 (request call id 273) took 4805 ms. Trace:
I20260812 19:27:13.140311 7956 rpcz_store.cc:276] 0812 19:27:08.293704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.098576 (+4804872us) service_pool.cc:227] Handling call
0812 19:27:13.099082 (+ 506us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:13.141258 7956 master_service.cc:946] ReplaceTablet: received request to replace tablet 8c9d071f07e5410d9e660986ab6858ef from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:13.141786 8152 tablet_service.cc:1467] Processing CreateTablet for tablet 0df3401001074c62883da06902530399 (DEFAULT_TABLE table=default.Table_4ba940c06806406eb455a26f9e2c0917 [id=fe03d45525a94b4d8980f8b96e14c696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.142817 8152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df3401001074c62883da06902530399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.144665 7956 rpcz_store.cc:275] Call kudu.master.MasterService.GetMasterRegistration from 127.0.0.1:51394 (request call id 1) took 1644 ms. Trace:
I20260812 19:27:13.157140 7956 rpcz_store.cc:276] 0812 19:27:11.500094 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.144080 (+1643986us) service_pool.cc:227] Handling call
0812 19:27:13.144587 (+ 507us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:13.161267 8446 leader_election.cc:302] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters: 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:13.168412 7957 rpcz_store.cc:269] 0812 19:27:12.260543 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.021044 (+760501us) service_pool.cc:227] Handling call
0812 19:27:13.027593 (+ 6549us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:13.171816 9768 tablet_replica.cc:330] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:13.179226 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:13.181828 7954 catalog_manager.cc:6040] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0] alter complete (version 1)
I20260812 19:27:13.160537 9667 raft_consensus.cc:482] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.186992 9667 raft_consensus.cc:504] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:13.190431 9667 leader_election.cc:288] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:13.157003 8153 tablet_service.cc:1467] Processing CreateTablet for tablet 89298e977bef4f519f68446bf75d0df9 (DEFAULT_TABLE table=default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.192375 8153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89298e977bef4f519f68446bf75d0df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.192677 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 with delete_type TABLET_DATA_DELETED (replaced by tablet a91c4d5adb3d4f97939e38e9cee79532) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:13.195840 8155 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:13.182811 8481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c258a18b8da47aabafd67023d3e5812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.200425 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:13.205214 8636 tablet_bootstrap.cc:492] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:13.205614 8636 ts_tablet_manager.cc:1397] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.695s user 0.021s sys 0.001s
I20260812 19:27:13.207304 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33591e906f0e433d98e07e424ea0b07f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:13.208684 8345 raft_consensus.cc:2379] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:13.208566 8636 raft_consensus.cc:348] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:13.209355 8636 raft_consensus.cc:374] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.209653 8636 raft_consensus.cc:729] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.210289 8636 consensus_queue.cc:260] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:13.211508 8479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc0601e681ba426991b22b6a7303ae2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.211819 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:13.213747 9653 leader_election.cc:288] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:13.213986 8107 leader_election.cc:341] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.219650 8849 master_runner.cc:232] Existing masters have differing terms: 2 vs 3
I20260812 19:27:13.220158 8849 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:27:13.220062 9616 consensus_queue.cc:1035] T ed3743a7dde744668cbe91759a499805 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.227488 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:13.228274 8352 raft_consensus.cc:2454] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:13.155140 9482 ts_tablet_manager.cc:1918] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:13.242313 9653 raft_consensus.cc:2781] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:13.243245 9653 raft_consensus.cc:482] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:13.243564 9653 raft_consensus.cc:3037] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.250447 9653 raft_consensus.cc:504] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.253054 9653 leader_election.cc:288] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:13.233019 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 71833.7us
W20260812 19:27:13.258760 8446 leader_election.cc:341] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 863e7ca808f54a989b3372aa4bfe361e
I20260812 19:27:13.259294 8446 leader_election.cc:302] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:13.261080 9767 raft_consensus.cc:2726] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.261613 9767 consensus_queue.cc:1035] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.264968 8446 leader_election.cc:302] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:13.269025 8636 ts_tablet_manager.cc:1428] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.063s user 0.006s sys 0.001s
I20260812 19:27:13.269892 8636 tablet_bootstrap.cc:492] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:13.281512 9774 raft_consensus.cc:482] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.254792 9482 log.cc:1196] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/22fe32c0d82845b8a9f0c0e4d88f7d39
I20260812 19:27:13.294566 9482 ts_tablet_manager.cc:1939] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
W20260812 19:27:13.188129 7954 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 41) took 3823 ms (client timeout 1000 ms). Trace:
I20260812 19:27:13.316612 9747 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:27:13.319579 9751 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 3 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:13.324802 9751 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:13.329042 8154 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e087bad986b423098a68fa5d05ff17a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:01 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:13.334182 8145 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b04529031f04302846b39d585d74ad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:13.302028 8108 leader_election.cc:302] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:13.336797 9667 raft_consensus.cc:2781] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:13.337222 9667 raft_consensus.cc:482] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:13.337749 9667 raft_consensus.cc:3037] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:13.341610 7959 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 35) took 6629 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.342036 7959 rpcz_store.cc:269] 0812 19:27:06.712614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.739881 (+ 27267us) service_pool.cc:227] Handling call
0812 19:27:13.341531 (+6601650us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":100148,"reported_tablets":36}
I20260812 19:27:13.357007 8623 tablet_bootstrap.cc:492] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:13.357589 8623 ts_tablet_manager.cc:1397] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.718s user 0.016s sys 0.001s
W20260812 19:27:13.359274 7953 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.193:56723 (request call id 36) took 5191 ms (client timeout 1000 ms). Trace:
W20260812 19:27:13.359377 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 94479.1us
W20260812 19:27:13.359668 7953 rpcz_store.cc:269] 0812 19:27:08.168214 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:08.236733 (+ 68519us) service_pool.cc:227] Handling call
0812 19:27:08.314054 (+ 77321us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:13.359209 (+5045155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28786,"reported_tablets":38,"spinlock_wait_cycles":24580864}
I20260812 19:27:13.360076 8446 leader_election.cc:302] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:13.360642 8443 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4
W20260812 19:27:13.361102 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 54583.2us
I20260812 19:27:13.368296 8510 raft_consensus.cc:1261] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Refusing update from remote peer 6a95b50ceede4dc99913aec28ddaa380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:13.369546 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 267) took 6467 ms. Trace:
I20260812 19:27:13.370329 9616 consensus_queue.cc:1035] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.364902 9767 raft_consensus.cc:3037] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.370070 9482 rpcz_store.cc:276] 0812 19:27:06.902245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.902372 (+ 127us) service_pool.cc:227] Handling call
0812 19:27:11.820797 (+4918425us) ts_tablet_manager.cc:1145] Deleting tablet 22fe32c0d82845b8a9f0c0e4d88f7d39
0812 19:27:11.836505 (+ 15708us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:12.968866 (+1132361us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:13.154875 (+186009us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:13.369471 (+214596us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":4856069}
I20260812 19:27:13.392987 7948 catalog_manager.cc:4841] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 (table default.Table_3e9699a08d4b49aa9f6e7b830481562a [id=9d326d6a71a4424494c26dc6095b1649]) successfully deleted
I20260812 19:27:13.391785 9767 raft_consensus.cc:2726] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.396828 8485 tablet_service.cc:1514] Processing DeleteTablet for tablet 22fe32c0d82845b8a9f0c0e4d88f7d39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:57 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:13.397575 8482 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:13.398025 8491 tablet_service.cc:1514] Processing DeleteTablet for tablet bc5c4ef0441c49fca31b2fc8a2c9abd4 with delete_type TABLET_DATA_DELETED (replaced by tablet f57f252b520945328fdaaa9adef593a1) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:13.398936 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 89298e977bef4f519f68446bf75d0df9 (DEFAULT_TABLE table=default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.400187 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89298e977bef4f519f68446bf75d0df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.400949 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 0df3401001074c62883da06902530399 (DEFAULT_TABLE table=default.Table_4ba940c06806406eb455a26f9e2c0917 [id=fe03d45525a94b4d8980f8b96e14c696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.401876 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df3401001074c62883da06902530399. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.402524 8623 raft_consensus.cc:348] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.403213 8623 raft_consensus.cc:374] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.403445 8623 raft_consensus.cc:729] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.395048 9767 raft_consensus.cc:2726] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:13.405296 8492 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d660422701a423794416b01cea825b4 with delete_type TABLET_DATA_DELETED (replaced by tablet 6ff5b2d23d734217b0b10e50834b8883) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:13.406389 8485 tablet_service.cc:1467] Processing CreateTablet for tablet aff8c4a6f27c499eb555d97017cb3a4c (DEFAULT_TABLE table=default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.407426 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff8c4a6f27c499eb555d97017cb3a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.408828 8636 tablet_bootstrap.cc:654] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.412344 8484 tablet_service.cc:1514] Processing DeleteTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:13.414669 9768 raft_consensus.cc:2229] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:13.416930 9768 raft_consensus.cc:2258] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:13.419986 9768 ts_tablet_manager.cc:1905] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:13.282351 9774 raft_consensus.cc:504] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.469960 9782 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:13.470778 9782 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
W20260812 19:27:13.471001 8446 consensus_peers.cc:487] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:13.312506 7954 rpcz_store.cc:269] 0812 19:27:09.364906 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.502242 (+137336us) service_pool.cc:227] Handling call
0812 19:27:09.617953 (+115711us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400021554. stack: 00007f05e7f64033 00007f05e7f63f30 00007f05e7ae5534 00000000004db2b4 00000000004db249 00007f05eee64af0 00007f05eeee7f2a 00007f05f0db3d6c 00007f05f0eadc3e 00007f05ee9e4fb4 00007f05ee9e4f42 00007f05ee9e4e71 00007f05ee9e4dec 00007f05ee9e40a2 00007f05ecc9a94c 00007f05ecc99d86
0812 19:27:13.188052 (+3570099us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0812 19:27:12.989138 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:12.989728 (+ 590us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:12.989770 (+ 42us) write_op.cc:435] Acquired schema lock
0812 19:27:12.989789 (+ 19us) tablet.cc:660] Decoding operations
0812 19:27:12.990266 (+ 477us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:12.990326 (+ 60us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:12.990361 (+ 35us) tablet.cc:683] Acquiring locks for 2 operations
0812 19:27:12.990739 (+ 378us) tablet.cc:699] Row locks acquired
0812 19:27:12.990758 (+ 19us) write_op.cc:260] PREPARE: finished
0812 19:27:12.990921 (+ 163us) write_op.cc:270] Start()
0812 19:27:12.991037 (+ 116us) write_op.cc:276] Timestamp: P: 1786562832990844 usec, L: 0
0812 19:27:12.991059 (+ 22us) op_driver.cc:331] REPLICATION: starting
0812 19:27:12.991773 (+ 714us) log.cc:842] Serialized 913 byte log entry
0812 19:27:13.006191 (+ 14418us) op_driver.cc:444] REPLICATION: finished
0812 19:27:13.006587 (+ 396us) write_op.cc:301] APPLY: starting
0812 19:27:13.006660 (+ 73us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:13.006796 (+ 136us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:13.006929 (+ 133us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:13.007266 (+ 337us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:13.007452 (+ 186us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0812 19:27:13.007513 (+ 61us) write_op.cc:312] APPLY: finished
0812 19:27:13.007745 (+ 232us) log.cc:842] Serialized 29 byte log entry
0812 19:27:13.011465 (+ 3720us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:13.011559 (+ 94us) write_op.cc:454] Released schema lock
0812 19:27:13.011601 (+ 42us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:13.011802 (+ 201us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:13.011846 (+ 44us) write_op.cc:454] Released schema lock
Related trace 'op':
0812 19:27:13.079449 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0812 19:27:13.079926 (+ 477us) write_op.cc:432] Acquiring schema lock in shared mode
0812 19:27:13.079957 (+ 31us) write_op.cc:435] Acquired schema lock
0812 19:27:13.079976 (+ 19us) tablet.cc:660] Decoding operations
0812 19:27:13.080302 (+ 326us) write_op.cc:620] Acquiring the partition lock for write op
0812 19:27:13.080357 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0812 19:27:13.080387 (+ 30us) tablet.cc:683] Acquiring locks for 1 operations
0812 19:27:13.080557 (+ 170us) tablet.cc:699] Row locks acquired
0812 19:27:13.080576 (+ 19us) write_op.cc:260] PREPARE: finished
0812 19:27:13.080706 (+ 130us) write_op.cc:270] Start()
0812 19:27:13.080803 (+ 97us) write_op.cc:276] Timestamp: P: 1786562833080631 usec, L: 0
0812 19:27:13.080825 (+ 22us) op_driver.cc:331] REPLICATION: starting
0812 19:27:13.081434 (+ 609us) log.cc:842] Serialized 356 byte log entry
0812 19:27:13.094617 (+ 13183us) op_driver.cc:444] REPLICATION: finished
0812 19:27:13.094949 (+ 332us) write_op.cc:301] APPLY: starting
0812 19:27:13.095016 (+ 67us) tablet.cc:1365] starting BulkCheckPresence
0812 19:27:13.095123 (+ 107us) tablet.cc:1368] finished BulkCheckPresence
0812 19:27:13.095218 (+ 95us) tablet.cc:1370] starting ApplyRowOperation cycle
0812 19:27:13.095426 (+ 208us) tablet.cc:1381] finished ApplyRowOperation cycle
0812 19:27:13.095575 (+ 149us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0812 19:27:13.095626 (+ 51us) write_op.cc:312] APPLY: finished
0812 19:27:13.095810 (+ 184us) log.cc:842] Serialized 23 byte log entry
0812 19:27:13.095967 (+ 157us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:13.096037 (+ 70us) write_op.cc:454] Released schema lock
0812 19:27:13.096069 (+ 32us) write_op.cc:341] FINISH: Updating metrics
0812 19:27:13.096243 (+ 174us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:13.096327 (+ 84us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116656,"reported_tablets":26,"spinlock_wait_cycles":232849792,"child_traces":[["op",{"apply.queue_time_us":206,"apply.run_cpu_time_us":1956,"apply.run_wall_time_us":5478,"num_ops":2,"prepare.queue_time_us":103,"prepare.run_cpu_time_us":3118,"prepare.run_wall_time_us":10394,"raft.queue_time_us":110,"raft.run_cpu_time_us":787,"raft.run_wall_time_us":788,"replication_time_us":15014}],["op",{"apply.queue_time_us":180,"apply.run_cpu_time_us":1535,"apply.run_wall_time_us":1534,"num_ops":1,"prepare.queue_time_us":835,"prepare.run_cpu_time_us":2296,"prepare.run_wall_time_us":2296,"raft.queue_time_us":1344,"raft.run_cpu_time_us":725,"raft.run_wall_time_us":724,"replication_time_us":13703}]]}
I20260812 19:27:13.473354 9735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:27:13.486239 8636 tablet_bootstrap.cc:492] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:13.486686 8636 ts_tablet_manager.cc:1397] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.217s user 0.003s sys 0.006s
I20260812 19:27:13.491406 8636 raft_consensus.cc:348] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.404038 8623 consensus_queue.cc:260] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.492062 8636 raft_consensus.cc:374] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.494680 8636 raft_consensus.cc:729] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.495373 8636 consensus_queue.cc:260] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.501260 8636 ts_tablet_manager.cc:1428] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260812 19:27:13.503955 9768 ts_tablet_manager.cc:1918] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:13.504668 9768 log.cc:1196] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/04d56a12f8964d4a9ccbc5f870b89713
W20260812 19:27:13.505600 8446 leader_election.cc:341] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:13.508493 8446 leader_election.cc:302] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:13.509886 9767 raft_consensus.cc:2726] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:13.513614 9768 ts_tablet_manager.cc:1939] T 04d56a12f8964d4a9ccbc5f870b89713 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
W20260812 19:27:13.519512 9690 consensus_meta.cc:287] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7: Time spent flushing consensus metadata: real 0.774s user 0.003s sys 0.005s
W20260812 19:27:13.493110 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 48712.5us
I20260812 19:27:13.493953 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84bf28a3e174f3b88f8758b09ced1f1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:13.528527 8176 raft_consensus.cc:3037] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:13.536648 8333 tablet_service.cc:1467] Processing CreateTablet for tablet d30c274273c3496cb0a8b8650b504250 (DEFAULT_TABLE table=default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.501528 9667 raft_consensus.cc:504] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:13.538161 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30c274273c3496cb0a8b8650b504250. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.540053 9667 leader_election.cc:288] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:13.541128 8328 tablet_service.cc:1467] Processing CreateTablet for tablet 7a530a6bcdb04b268c7a3f4becb065e2 (DEFAULT_TABLE table=default.Table_bcd87c04648c489e9d444bbc8470ccd7 [id=95e83940f5bc4baeba825114eadde1a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.542300 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7a530a6bcdb04b268c7a3f4becb065e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.544430 8176 raft_consensus.cc:2454] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 2.
I20260812 19:27:13.545178 8322 tablet_service.cc:1467] Processing CreateTablet for tablet 7c258a18b8da47aabafd67023d3e5812 (DEFAULT_TABLE table=default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.545531 8446 leader_election.cc:302] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:13.546409 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7c258a18b8da47aabafd67023d3e5812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.546428 9764 raft_consensus.cc:2781] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:13.546896 9764 raft_consensus.cc:686] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:13.547727 9764 consensus_queue.cc:237] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.549147 8332 tablet_service.cc:1467] Processing CreateTablet for tablet c881ad61438d4a978e3c479aefcfa4cb (DEFAULT_TABLE table=default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.550171 8332 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c881ad61438d4a978e3c479aefcfa4cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.553104 8330 tablet_service.cc:1467] Processing CreateTablet for tablet f9aa94ea25c04790902a3a4d0c0099ad (DEFAULT_TABLE table=default.Table_a059cc3e3a9345ddbd2e7c031966470f [id=a095e4d6dde54adfbd59686c9e67d995]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.554173 8330 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f9aa94ea25c04790902a3a4d0c0099ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.560930 8623 ts_tablet_manager.cc:1428] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.203s user 0.005s sys 0.000s
I20260812 19:27:13.567251 8327 tablet_service.cc:1514] Processing DeleteTablet for tablet 04d56a12f8964d4a9ccbc5f870b89713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:06 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.569096 8323 tablet_service.cc:1467] Processing CreateTablet for tablet cc0601e681ba426991b22b6a7303ae2c (DEFAULT_TABLE table=default.Table_b25383bb16404fac95cc1d79e20e1185 [id=ed6829a78ccb41109d1f99403f38ddb3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.570382 8323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cc0601e681ba426991b22b6a7303ae2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.572654 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 94407c13a91c4a76bd3aa1c1c8032384 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:07 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.599411 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2b4ef63a53540e6be590243b1d27330" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:13.600565 8516 raft_consensus.cc:3037] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.600814 8511 raft_consensus.cc:1261] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Refusing update from remote peer 6a95b50ceede4dc99913aec28ddaa380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:13.516984 9774 leader_election.cc:288] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:13.519937 9690 raft_consensus.cc:504] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.604449 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:13.616536 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 249da5c0bd73498bbfc8f41e7513a9d4 with delete_type TABLET_DATA_DELETED (replaced by tablet a91c4d5adb3d4f97939e38e9cee79532) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.617589 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet a84bf28a3e174f3b88f8758b09ced1f1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.618563 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 863e7ca808f54a989b3372aa4bfe361e with delete_type TABLET_DATA_DELETED (replaced by tablet 067fdfc16a7e44c2b3dac5fe262a5728) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.619220 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 3740799e07f94fe981d395ef8c3d7973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:26:55 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.620313 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet a49e46c8ba704680bf12423854883b55 with delete_type TABLET_DATA_DELETED (replaced by tablet b4d07516dc1c4193b4cbd68185f92891) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.565276 9482 tablet_replica.cc:330] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:13.621299 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bce01fd81f04f23a8cddc3a7b5eae8f with delete_type TABLET_DATA_DELETED (replaced by tablet 94407c13a91c4a76bd3aa1c1c8032384) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.621562 9482 raft_consensus.cc:2229] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:13.606135 9667 consensus_queue.cc:1035] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.622349 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc with delete_type TABLET_DATA_DELETED (replaced by tablet c607886a76344185aa9af5da797b9ae8) from {username='slave'} at 127.0.0.1:44394
W20260812 19:27:13.606114 8107 leader_election.cc:341] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.623370 8329 tablet_service.cc:1514] Processing DeleteTablet for tablet 544d3d74baa6477da11abbee139ee66f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:13.626155 8354 raft_consensus.cc:2379] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:13.629102 9690 leader_election.cc:288] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:13.631182 9482 pending_rounds.cc:62] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Trying to abort 1 pending ops.
I20260812 19:27:13.631459 9482 pending_rounds.cc:68] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7317761362686853120 op_type: NO_OP noop_request { }
I20260812 19:27:13.631875 9482 raft_consensus.cc:2866] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:13.633530 9482 raft_consensus.cc:2258] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:13.634473 9702 consensus_queue.cc:1035] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.645183 8623 tablet_bootstrap.cc:492] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:13.647565 9632 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 19:27:13.648949 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 89298e977bef4f519f68446bf75d0df9 (DEFAULT_TABLE table=default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.650089 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89298e977bef4f519f68446bf75d0df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.653137 9482 ts_tablet_manager.cc:1905] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:13.669811 8326 tablet_service.cc:1467] Processing CreateTablet for tablet aff8c4a6f27c499eb555d97017cb3a4c (DEFAULT_TABLE table=default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.670794 8636 tablet_bootstrap.cc:492] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:13.671347 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff8c4a6f27c499eb555d97017cb3a4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:13.672886 9616 raft_consensus.cc:482] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.673403 9616 raft_consensus.cc:504] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.678369 9616 leader_election.cc:288] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:13.679520 8623 tablet_bootstrap.cc:654] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.685693 8325 tablet_service.cc:1467] Processing CreateTablet for tablet 0df3401001074c62883da06902530399 (DEFAULT_TABLE table=default.Table_4ba940c06806406eb455a26f9e2c0917 [id=fe03d45525a94b4d8980f8b96e14c696]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:13.686982 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0df3401001074c62883da06902530399. 1 dirs total, 0 dirs full, 0 dirs failed
W20260812 19:27:13.692997 9785 log.cc:924] Time spent T 0fd84e685b2b4e819f4b61e442828b13 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.116s user 0.000s sys 0.000s
I20260812 19:27:13.696641 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:13.698844 9768 tablet_replica.cc:330] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:13.699687 9768 raft_consensus.cc:2229] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:13.700222 9768 raft_consensus.cc:2258] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:13.700816 8636 tablet_bootstrap.cc:654] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:13.698971 8107 leader_election.cc:341] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.703918 9768 ts_tablet_manager.cc:1905] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:13.704149 9784 log.cc:924] Time spent T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.121s user 0.001s sys 0.000s
I20260812 19:27:13.712780 9764 raft_consensus.cc:482] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:13.713579 9764 raft_consensus.cc:504] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:13.716858 9764 leader_election.cc:288] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:13.719759 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:13.724826 8636 tablet_bootstrap.cc:492] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:13.725394 8636 ts_tablet_manager.cc:1397] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.055s user 0.008s sys 0.005s
I20260812 19:27:13.732884 8636 raft_consensus.cc:348] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.740028 8636 raft_consensus.cc:374] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.740334 8636 raft_consensus.cc:729] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.753892 8636 consensus_queue.cc:260] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.755523 8636 ts_tablet_manager.cc:1428] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.030s user 0.004s sys 0.002s
I20260812 19:27:13.756767 8182 raft_consensus.cc:2379] T 384506029b4e49639f87f6d7005fa0a9 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:13.730746 9482 ts_tablet_manager.cc:1918] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 19:27:13.764602 9482 log.cc:1196] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:13.765599 9482 ts_tablet_manager.cc:1939] T 3740799e07f94fe981d395ef8c3d7973 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:13.755615 8623 tablet_bootstrap.cc:492] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:13.767026 8623 ts_tablet_manager.cc:1397] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.122s user 0.015s sys 0.002s
I20260812 19:27:13.769430 8623 raft_consensus.cc:348] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.785797 8636 tablet_bootstrap.cc:492] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:13.786206 8623 raft_consensus.cc:374] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.786895 8623 raft_consensus.cc:729] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.791141 9616 consensus_queue.cc:1035] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:13.792115 8623 consensus_queue.cc:260] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.795107 9751 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:13.795935 9751 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:13.781864 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 268) took 6878 ms. Trace:
I20260812 19:27:13.807760 9482 rpcz_store.cc:276] 0812 19:27:06.903048 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.903167 (+ 119us) service_pool.cc:227] Handling call
0812 19:27:13.492619 (+6589452us) ts_tablet_manager.cc:1145] Deleting tablet 3740799e07f94fe981d395ef8c3d7973
0812 19:27:13.565114 (+ 72495us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:13.630772 (+ 65658us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b54001449a0. stack: 00007f98318ea033 00007f98318e9f30 00007f983146b534 00000000004db2b4 00000000004db249 00007f98387ea471 00007f98387f340d 00007f98387e1050 00007f9838844aba 00007f983886d375 00007f9838c8326c 00007f9839890cfa 00007f98398c0e10 00007f98398a7e0d 00007f98398a7db9 00007f98398a7d49
0812 19:27:13.686998 (+ 56226us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:13.730506 (+ 43508us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:13.781787 (+ 51281us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23412,"spinlock_wait_cycles":12765568,"tablet-delete.queue_time_us":6551666}
I20260812 19:27:13.813285 8636 tablet_bootstrap.cc:654] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.809598 8623 ts_tablet_manager.cc:1428] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.042s user 0.005s sys 0.000s
W20260812 19:27:13.825892 8278 leader_election.cc:341] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.827193 8278 leader_election.cc:302] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:13.824123 9768 ts_tablet_manager.cc:1918] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:13.830503 9768 log.cc:1196] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/22fe32c0d82845b8a9f0c0e4d88f7d39
I20260812 19:27:13.835278 9768 ts_tablet_manager.cc:1939] T 22fe32c0d82845b8a9f0c0e4d88f7d39 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:13.846033 9789 tablet_replica.cc:330] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:13.855433 8636 tablet_bootstrap.cc:492] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:13.856647 8636 ts_tablet_manager.cc:1397] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.071s user 0.007s sys 0.004s
I20260812 19:27:13.885313 8623 tablet_bootstrap.cc:492] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:13.888474 9482 tablet_replica.cc:330] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:13.889510 9482 raft_consensus.cc:2229] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:13.890319 9482 raft_consensus.cc:2258] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:13.893446 8623 tablet_bootstrap.cc:654] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:13.899134 9482 ts_tablet_manager.cc:1905] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:13.912921 9786 raft_consensus.cc:2726] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:13.920344 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2b4ef63a53540e6be590243b1d27330" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:13.930562 8623 tablet_bootstrap.cc:492] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:13.931066 8623 ts_tablet_manager.cc:1397] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.046s user 0.011s sys 0.000s
W20260812 19:27:13.933657 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 109037us
W20260812 19:27:13.936093 8278 leader_election.cc:341] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:13.936038 8623 raft_consensus.cc:348] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.941335 9768 tablet_replica.cc:330] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:13.942101 8623 raft_consensus.cc:374] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.942418 8623 raft_consensus.cc:729] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.941287 8636 raft_consensus.cc:348] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.942773 8636 raft_consensus.cc:374] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.943029 8636 raft_consensus.cc:729] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.943727 8623 consensus_queue.cc:260] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.946810 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:13.947422 8177 raft_consensus.cc:3037] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:13.957561 8177 raft_consensus.cc:2454] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:13.947209 8623 ts_tablet_manager.cc:1428] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20260812 19:27:13.960692 8636 consensus_queue.cc:260] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.967168 8636 ts_tablet_manager.cc:1428] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.107s user 0.003s sys 0.005s
I20260812 19:27:13.967957 8627 tablet_bootstrap.cc:492] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:13.968447 8636 tablet_bootstrap.cc:492] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:13.981009 8623 tablet_bootstrap.cc:492] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:13.950615 9482 ts_tablet_manager.cc:1918] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 19:27:13.988721 9482 log.cc:1196] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/a49e46c8ba704680bf12423854883b55
I20260812 19:27:13.990139 8627 ts_tablet_manager.cc:1397] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 1.526s user 0.015s sys 0.017s
I20260812 19:27:13.990999 9482 ts_tablet_manager.cc:1939] T a49e46c8ba704680bf12423854883b55 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:13.993134 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 269) took 7088 ms. Trace:
I20260812 19:27:13.992722 8627 raft_consensus.cc:348] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.995991 8627 raft_consensus.cc:374] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:13.996457 8627 raft_consensus.cc:729] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:13.997229 8627 consensus_queue.cc:260] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:13.999413 8627 ts_tablet_manager.cc:1428] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20260812 19:27:14.010375 9751 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:14.010900 9751 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:14.012977 9751 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:14.013150 8281 leader_election.cc:302] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:14.013317 9482 rpcz_store.cc:276] 0812 19:27:06.904574 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.904691 (+ 117us) service_pool.cc:227] Handling call
0812 19:27:13.816192 (+6911501us) ts_tablet_manager.cc:1145] Deleting tablet a49e46c8ba704680bf12423854883b55
0812 19:27:13.888320 (+ 72128us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:13.919855 (+ 31535us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:13.950407 (+ 30552us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:13.993071 (+ 42664us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":6875107}
I20260812 19:27:14.014124 9659 raft_consensus.cc:2781] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:14.014640 9659 raft_consensus.cc:686] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:14.018333 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:14.010934 8623 tablet_bootstrap.cc:654] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.020131 9482 tablet_replica.cc:330] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:14.033180 8636 tablet_bootstrap.cc:654] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.015597 9659 consensus_queue.cc:237] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:14.021793 9482 raft_consensus.cc:2229] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:14.039247 9789 raft_consensus.cc:2229] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:14.039433 9482 raft_consensus.cc:2258] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.040278 9789 raft_consensus.cc:2258] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.040647 8627 tablet_bootstrap.cc:492] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:14.043486 9789 ts_tablet_manager.cc:1905] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.045341 9768 raft_consensus.cc:2229] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:14.045572 9482 ts_tablet_manager.cc:1905] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.046149 9768 raft_consensus.cc:2258] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.047991 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:14.048906 8354 raft_consensus.cc:3037] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.049808 9768 ts_tablet_manager.cc:1905] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.060708 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:14.061878 8345 raft_consensus.cc:2454] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:27:14.078510 8281 leader_election.cc:341] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:14.079793 8281 leader_election.cc:302] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:14.096033 9790 raft_consensus.cc:2726] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:14.080804 9690 consensus_queue.cc:1035] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260812 19:27:14.105422 8354 raft_consensus.cc:2454] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
W20260812 19:27:14.147100 8443 leader_election.cc:341] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a84bf28a3e174f3b88f8758b09ced1f1
I20260812 19:27:14.148980 8108 leader_election.cc:302] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:14.151486 9667 raft_consensus.cc:2726] T b31c1afb090041d7b6ae35a846772b1d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:14.152011 9667 consensus_queue.cc:1035] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:14.152563 8623 tablet_bootstrap.cc:492] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:14.153095 8623 ts_tablet_manager.cc:1397] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.172s user 0.013s sys 0.007s
I20260812 19:27:14.164402 8627 tablet_bootstrap.cc:654] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.165213 8623 raft_consensus.cc:348] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.166010 8623 raft_consensus.cc:374] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:14.166333 8623 raft_consensus.cc:729] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:14.167016 8623 consensus_queue.cc:260] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.168767 8636 tablet_bootstrap.cc:492] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:14.169240 8636 ts_tablet_manager.cc:1397] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.201s user 0.011s sys 0.002s
I20260812 19:27:14.171542 8636 raft_consensus.cc:348] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:14.174546 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 60389.2us
I20260812 19:27:14.178086 9690 consensus_queue.cc:1035] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:14.183172 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b31c1afb090041d7b6ae35a846772b1d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:14.183843 8510 raft_consensus.cc:3037] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.187914 9482 ts_tablet_manager.cc:1918] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:14.190886 8510 raft_consensus.cc:2454] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:14.190274 8281 leader_election.cc:302] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:14.193728 8514 raft_consensus.cc:3037] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.198642 9690 raft_consensus.cc:2781] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:14.199465 9690 raft_consensus.cc:686] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:14.200393 9690 consensus_queue.cc:237] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.204763 9790 consensus_queue.cc:1035] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:14.207286 8516 raft_consensus.cc:3037] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.221724 8627 tablet_bootstrap.cc:492] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:14.172183 8636 raft_consensus.cc:374] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:14.228574 8636 raft_consensus.cc:729] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:14.229318 8636 consensus_queue.cc:260] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:14.231408 8636 ts_tablet_manager.cc:1428] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.062s user 0.004s sys 0.000s
I20260812 19:27:14.241036 9809 raft_consensus.cc:482] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:14.241596 9809 raft_consensus.cc:504] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.243479 9809 leader_election.cc:288] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:14.250418 9482 log.cc:1196] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/a84bf28a3e174f3b88f8758b09ced1f1
I20260812 19:27:14.251348 9482 ts_tablet_manager.cc:1939] T a84bf28a3e174f3b88f8758b09ced1f1 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:14.209381 8623 ts_tablet_manager.cc:1428] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.056s user 0.003s sys 0.003s
W20260812 19:27:14.215564 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 64519.2us
I20260812 19:27:14.255589 8108 leader_election.cc:302] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:14.255792 9810 consensus_queue.cc:1035] T 33591e906f0e433d98e07e424ea0b07f P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:14.257167 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:14.258435 9810 raft_consensus.cc:2781] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:14.258829 9810 raft_consensus.cc:482] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:14.259110 9810 raft_consensus.cc:3037] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.261379 8108 leader_election.cc:302] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:14.262178 9667 raft_consensus.cc:2781] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:14.262626 9667 raft_consensus.cc:686] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:14.263368 9667 consensus_queue.cc:237] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:14.271064 9810 raft_consensus.cc:504] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.273465 8623 tablet_bootstrap.cc:492] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:14.288396 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "384506029b4e49639f87f6d7005fa0a9" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:14.290198 8627 ts_tablet_manager.cc:1397] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.250s user 0.007s sys 0.007s
I20260812 19:27:14.295857 9768 ts_tablet_manager.cc:1918] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:14.320533 9810 leader_election.cc:288] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:14.320652 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 271) took 7409 ms. Trace:
I20260812 19:27:14.321136 9482 rpcz_store.cc:276] 0812 19:27:06.911548 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.911691 (+ 143us) service_pool.cc:227] Handling call
0812 19:27:14.019954 (+7108263us) ts_tablet_manager.cc:1145] Deleting tablet a84bf28a3e174f3b88f8758b09ced1f1
0812 19:27:14.020010 (+ 56us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.079964 (+ 59954us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.187699 (+107735us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.320585 (+132886us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7078466}
I20260812 19:27:14.323451 9482 tablet_replica.cc:330] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:14.302439 8636 tablet_bootstrap.cc:492] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:14.352669 9768 log.cc:1196] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/863e7ca808f54a989b3372aa4bfe361e
I20260812 19:27:14.353647 9768 ts_tablet_manager.cc:1939] T 863e7ca808f54a989b3372aa4bfe361e P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:14.307915 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:14.359109 8636 tablet_bootstrap.cc:654] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:14.361114 8281 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 62355.1us
I20260812 19:27:14.363533 9690 consensus_queue.cc:1035] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:14.365064 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e087bad986b423098a68fa5d05ff17a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:14.367714 9789 ts_tablet_manager.cc:1918] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:14.368093 9789 log.cc:1196] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/04d56a12f8964d4a9ccbc5f870b89713
I20260812 19:27:14.369072 9789 ts_tablet_manager.cc:1939] T 04d56a12f8964d4a9ccbc5f870b89713 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:14.370988 9789 tablet_replica.cc:330] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:14.371830 9789 raft_consensus.cc:2229] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
W20260812 19:27:14.357897 8107 leader_election.cc:341] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:14.324234 9482 raft_consensus.cc:2229] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:14.378578 9482 raft_consensus.cc:2258] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.384864 8443 leader_election.cc:302] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:14.385710 9809 raft_consensus.cc:2726] T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:14.386603 8443 leader_election.cc:302] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:14.387851 9767 raft_consensus.cc:2726] T 7e087bad986b423098a68fa5d05ff17a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:14.359109 8623 tablet_bootstrap.cc:654] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.391165 8627 raft_consensus.cc:348] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.391916 8627 raft_consensus.cc:374] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:14.392169 8627 raft_consensus.cc:729] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:14.392814 8627 consensus_queue.cc:260] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.399344 9768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 250) took 1002 ms. Trace:
I20260812 19:27:14.399757 9768 rpcz_store.cc:276] 0812 19:27:13.396813 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.397403 (+ 590us) service_pool.cc:227] Handling call
0812 19:27:13.852915 (+455512us) ts_tablet_manager.cc:1145] Deleting tablet 863e7ca808f54a989b3372aa4bfe361e
0812 19:27:13.941168 (+ 88253us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.176405 (+235237us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.295608 (+119203us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.399117 (+103509us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":102281,"tablet-delete.queue_time_us":454810}
I20260812 19:27:14.402230 9768 tablet_replica.cc:330] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:14.408607 9482 ts_tablet_manager.cc:1905] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.418759 9810 raft_consensus.cc:482] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:14.419257 9810 raft_consensus.cc:504] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.421468 9810 leader_election.cc:288] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:14.423267 8623 tablet_bootstrap.cc:492] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:14.423812 8623 ts_tablet_manager.cc:1397] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.150s user 0.009s sys 0.002s
I20260812 19:27:14.424908 9810 raft_consensus.cc:482] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:14.425340 9810 raft_consensus.cc:504] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.428865 9810 leader_election.cc:288] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:14.423380 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdb7cce923c4ed98e400c121b6237ba" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:14.428128 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787047cca4ce4c6884ce5bd07a93f077" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:14.431989 8107 leader_election.cc:341] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:14.432669 8107 leader_election.cc:341] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:14.433653 9789 raft_consensus.cc:2258] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.434126 9768 raft_consensus.cc:2229] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:14.434650 9768 pending_rounds.cc:62] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Trying to abort 1 pending ops.
W20260812 19:27:14.439585 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 45521.8us
W20260812 19:27:14.459896 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet c6075b2e46524829962d2b84353013b2 consensus state has no leader
I20260812 19:27:14.460875 9768 pending_rounds.cc:68] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7317761344976560128 op_type: NO_OP noop_request { }
I20260812 19:27:14.461333 9768 raft_consensus.cc:2866] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:27:14.461699 9768 raft_consensus.cc:2258] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.463546 9768 ts_tablet_manager.cc:1905] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.469885 8623 raft_consensus.cc:348] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.470726 8623 raft_consensus.cc:374] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:14.471041 8623 raft_consensus.cc:729] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:14.471786 8623 consensus_queue.cc:260] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.490897 8627 ts_tablet_manager.cc:1428] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.200s user 0.005s sys 0.001s
W20260812 19:27:14.491387 8278 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 60560.5us
W20260812 19:27:14.492654 8278 consensus_peers.cc:487] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:14.501842 8636 tablet_bootstrap.cc:492] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:14.502281 8636 ts_tablet_manager.cc:1397] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.200s user 0.007s sys 0.012s
I20260812 19:27:14.504834 8636 raft_consensus.cc:348] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.505473 8636 raft_consensus.cc:374] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:14.505723 8636 raft_consensus.cc:729] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:14.506283 8636 consensus_queue.cc:260] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.516394 8623 ts_tablet_manager.cc:1428] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.092s user 0.006s sys 0.000s
I20260812 19:27:14.521080 8623 tablet_bootstrap.cc:492] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:14.521839 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:14.522426 8345 raft_consensus.cc:3037] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.524660 9809 raft_consensus.cc:482] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:14.525113 9809 raft_consensus.cc:504] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.527170 9809 leader_election.cc:288] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:14.531332 8345 raft_consensus.cc:2454] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:14.533083 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:14.550864 9482 ts_tablet_manager.cc:1918] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:14.565303 8636 ts_tablet_manager.cc:1428] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.063s user 0.005s sys 0.001s
I20260812 19:27:14.600589 9482 log.cc:1196] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/544d3d74baa6477da11abbee139ee66f
I20260812 19:27:14.601686 9482 ts_tablet_manager.cc:1939] T 544d3d74baa6477da11abbee139ee66f P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:14.596961 8623 tablet_bootstrap.cc:654] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.551436 9789 ts_tablet_manager.cc:1905] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:14.576210 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 91461.3us
I20260812 19:27:14.628882 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 270) took 7719 ms. Trace:
I20260812 19:27:14.629284 9482 rpcz_store.cc:276] 0812 19:27:06.909722 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.909872 (+ 150us) service_pool.cc:227] Handling call
0812 19:27:14.323281 (+7413409us) ts_tablet_manager.cc:1145] Deleting tablet 544d3d74baa6477da11abbee139ee66f
0812 19:27:14.323347 (+ 66us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.494776 (+171429us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.550637 (+ 55861us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.628818 (+ 78181us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7381550}
I20260812 19:27:14.631270 9482 tablet_replica.cc:330] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:14.632135 9482 raft_consensus.cc:2229] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260812 19:27:14.635677 7781 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.618s (SENT)
W20260812 19:27:14.646086 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 151440us
I20260812 19:27:14.660624 8636 tablet_bootstrap.cc:492] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:14.675760 9786 consensus_queue.cc:1035] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:14.682157 9659 consensus_queue.cc:1035] T 384506029b4e49639f87f6d7005fa0a9 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:14.604332 8627 tablet_bootstrap.cc:492] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:14.688705 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 53176us
I20260812 19:27:14.701789 9482 raft_consensus.cc:2258] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.685036 8623 tablet_bootstrap.cc:492] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:14.703886 9786 raft_consensus.cc:482] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:14.704140 8623 ts_tablet_manager.cc:1397] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.183s user 0.009s sys 0.002s
I20260812 19:27:14.704351 9786 raft_consensus.cc:504] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.706310 9786 leader_election.cc:288] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:14.707770 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc25879cf7c434b91591a7c7382cdb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:14.708437 8182 raft_consensus.cc:2454] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:14.673799 9768 ts_tablet_manager.cc:1918] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 19:27:14.709412 9768 log.cc:1196] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/bc5c4ef0441c49fca31b2fc8a2c9abd4
I20260812 19:27:14.709730 8281 leader_election.cc:302] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:14.711649 9768 ts_tablet_manager.cc:1939] T bc5c4ef0441c49fca31b2fc8a2c9abd4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:14.711505 9790 raft_consensus.cc:2781] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:14.711978 9790 raft_consensus.cc:482] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:14.712539 9790 raft_consensus.cc:3037] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.717864 9768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 248) took 1321 ms. Trace:
I20260812 19:27:14.703765 9482 ts_tablet_manager.cc:1905] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.733157 8627 tablet_bootstrap.cc:654] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.738133 9768 rpcz_store.cc:276] 0812 19:27:13.396240 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.397917 (+ 1677us) service_pool.cc:227] Handling call
0812 19:27:14.402005 (+1004088us) ts_tablet_manager.cc:1145] Deleting tablet bc5c4ef0441c49fca31b2fc8a2c9abd4
0812 19:27:14.402062 (+ 57us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.559047 (+156985us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.673521 (+114474us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.717799 (+ 44278us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1003559}
I20260812 19:27:14.744941 9768 tablet_replica.cc:330] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:14.746306 9768 raft_consensus.cc:2229] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:14.752593 9768 raft_consensus.cc:2258] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:14.724025 9789 ts_tablet_manager.cc:1918] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:14.726845 8108 leader_election.cc:302] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:14.761490 9810 raft_consensus.cc:2781] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:14.762204 9810 raft_consensus.cc:686] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:14.736922 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:14.741344 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787047cca4ce4c6884ce5bd07a93f077" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:14.741187 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdb7cce923c4ed98e400c121b6237ba" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:14.770644 8345 raft_consensus.cc:2454] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:14.763682 9810 consensus_queue.cc:237] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.755707 9768 ts_tablet_manager.cc:1905] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.754076 9789 log.cc:1196] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:14.773644 9789 ts_tablet_manager.cc:1939] T 249da5c0bd73498bbfc8f41e7513a9d4 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
W20260812 19:27:14.781980 8281 consensus_peers.cc:487] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:14.755158 8623 raft_consensus.cc:348] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.789242 8623 raft_consensus.cc:374] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:14.790479 8623 raft_consensus.cc:729] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:14.792943 8623 consensus_queue.cc:260] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.824406 8623 ts_tablet_manager.cc:1428] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.120s user 0.007s sys 0.000s
W20260812 19:27:14.822000 8281 consensus_peers.cc:487] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 544d3d74baa6477da11abbee139ee66f. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:14.835029 8627 tablet_bootstrap.cc:492] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:14.835427 8627 ts_tablet_manager.cc:1397] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.231s user 0.014s sys 0.000s
I20260812 19:27:14.829458 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 259) took 1211 ms. Trace:
I20260812 19:27:14.837695 8627 raft_consensus.cc:348] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.845129 8627 raft_consensus.cc:374] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:14.845404 8627 raft_consensus.cc:729] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:14.844082 8623 tablet_bootstrap.cc:492] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:14.846024 8627 consensus_queue.cc:260] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.837667 9789 rpcz_store.cc:276] 0812 19:27:13.616068 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.616248 (+ 180us) service_pool.cc:227] Handling call
0812 19:27:14.370845 (+754597us) ts_tablet_manager.cc:1145] Deleting tablet 249da5c0bd73498bbfc8f41e7513a9d4
0812 19:27:14.370882 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.549876 (+178994us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b2400002408. stack: 00007f865924a033 00007f8659249f30 00007f8658dcb534 00000000004db2b4 00000000004db249 00007f86590c0f11 00007f86590d4cf4 00007f86590d2dfb 00007f8659161559 00007f86591611e5 00007f8659160740 00007f865ffc4f05 00007f865ffde969 00007f865ffe30a3 00007f86605e33c5 00007f86611f0cfa
0812 19:27:14.618607 (+ 68731us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.723786 (+105179us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:14.827772 (+103986us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40525,"spinlock_wait_cycles":260254464,"tablet-delete.queue_time_us":753855}
I20260812 19:27:14.856210 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 260) took 1238 ms. Trace:
I20260812 19:27:14.866544 8627 ts_tablet_manager.cc:1428] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.031s user 0.006s sys 0.001s
I20260812 19:27:14.867472 8627 tablet_bootstrap.cc:492] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:14.888764 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 122366us
W20260812 19:27:14.893173 8443 consensus_peers.cc:487] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a84bf28a3e174f3b88f8758b09ced1f1. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:14.864017 9790 raft_consensus.cc:504] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:14.894129 8443 leader_election.cc:302] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:14.860312 9789 rpcz_store.cc:276] 0812 19:27:13.617360 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.617462 (+ 102us) service_pool.cc:227] Handling call
0812 19:27:14.852241 (+1234779us) ts_tablet_manager.cc:1145] Deleting tablet a84bf28a3e174f3b88f8758b09ced1f1
0812 19:27:14.853017 (+ 776us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.855523 (+ 2506us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1233879}
I20260812 19:27:14.897581 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 258) took 1282 ms. Trace:
I20260812 19:27:14.897922 9789 rpcz_store.cc:276] 0812 19:27:13.615702 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.618409 (+ 2707us) service_pool.cc:227] Handling call
0812 19:27:14.896622 (+1278213us) ts_tablet_manager.cc:1145] Deleting tablet 863e7ca808f54a989b3372aa4bfe361e
0812 19:27:14.896669 (+ 47us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.897515 (+ 846us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1277611}
I20260812 19:27:14.908142 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc25879cf7c434b91591a7c7382cdb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:14.908824 8182 raft_consensus.cc:3037] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.916922 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc25879cf7c434b91591a7c7382cdb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:14.919414 8627 tablet_bootstrap.cc:654] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.920007 8509 raft_consensus.cc:3037] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.921234 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdc25879cf7c434b91591a7c7382cdb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:14.929721 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 261) took 1311 ms. Trace:
I20260812 19:27:14.930164 9789 rpcz_store.cc:276] 0812 19:27:13.618312 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.619091 (+ 779us) service_pool.cc:227] Handling call
0812 19:27:14.908538 (+1289447us) ts_tablet_manager.cc:1145] Deleting tablet 3740799e07f94fe981d395ef8c3d7973
0812 19:27:14.929390 (+ 20852us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.929641 (+ 251us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1288925}
I20260812 19:27:14.931422 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 262) took 1311 ms. Trace:
I20260812 19:27:14.931756 9789 rpcz_store.cc:276] 0812 19:27:13.620073 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.620164 (+ 91us) service_pool.cc:227] Handling call
0812 19:27:14.931140 (+1310976us) ts_tablet_manager.cc:1145] Deleting tablet a49e46c8ba704680bf12423854883b55
0812 19:27:14.931183 (+ 43us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.931370 (+ 187us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1310454}
I20260812 19:27:14.932842 9789 tablet_replica.cc:330] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:14.933709 9789 raft_consensus.cc:2229] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:14.935447 9789 raft_consensus.cc:2258] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:14.936443 8278 leader_election.cc:341] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:14.937299 8278 leader_election.cc:341] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:14.937711 9789 ts_tablet_manager.cc:1905] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:14.944844 8623 tablet_bootstrap.cc:654] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:14.952728 8636 tablet_bootstrap.cc:654] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:14.961200 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 70501.7us
W20260812 19:27:14.964615 8108 leader_election.cc:341] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:14.965691 8108 leader_election.cc:302] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:14.967156 9561 raft_consensus.cc:2726] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:14.968179 8108 leader_election.cc:302] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:14.982760 9838 raft_consensus.cc:2781] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:14.956143 8182 raft_consensus.cc:2454] T bdc25879cf7c434b91591a7c7382cdb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:14.984383 9838 raft_consensus.cc:482] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:14.987069 9838 raft_consensus.cc:3037] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:14.994055 8281 leader_election.cc:302] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:14.915160 9790 leader_election.cc:288] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:14.994925 9833 raft_consensus.cc:2781] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:14.995376 9833 raft_consensus.cc:686] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:14.996162 9833 consensus_queue.cc:237] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.004108 9810 raft_consensus.cc:482] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:15.012899 9840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:15.024917 9810 raft_consensus.cc:504] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.028803 8627 tablet_bootstrap.cc:492] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:15.029251 8627 ts_tablet_manager.cc:1397] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.162s user 0.009s sys 0.003s
I20260812 19:27:15.013795 9840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:15.031498 8627 raft_consensus.cc:348] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:15.032171 8627 raft_consensus.cc:374] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.032629 8627 raft_consensus.cc:729] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.033264 8627 consensus_queue.cc:260] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:15.035455 8627 ts_tablet_manager.cc:1428] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260812 19:27:15.042578 8623 tablet_bootstrap.cc:492] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:15.043012 8623 ts_tablet_manager.cc:1397] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.200s user 0.015s sys 0.006s
I20260812 19:27:15.044621 9840 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:15.045584 9810 leader_election.cc:288] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:15.046857 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:15.054111 9838 raft_consensus.cc:504] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.055302 8623 raft_consensus.cc:348] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:15.057879 8623 raft_consensus.cc:374] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.058516 8623 raft_consensus.cc:729] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.060140 9838 leader_election.cc:288] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:15.061295 8623 consensus_queue.cc:260] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:15.064091 8623 ts_tablet_manager.cc:1428] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.021s user 0.005s sys 0.001s
I20260812 19:27:15.064893 8623 tablet_bootstrap.cc:492] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:15.070565 8623 tablet_bootstrap.cc:654] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.072327 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2b4ef63a53540e6be590243b1d27330" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:15.072942 8354 raft_consensus.cc:2454] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:15.075871 8627 tablet_bootstrap.cc:492] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:15.076593 8108 leader_election.cc:302] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:15.081315 8627 tablet_bootstrap.cc:654] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.082123 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdb7cce923c4ed98e400c121b6237ba" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:15.082679 8345 raft_consensus.cc:3037] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.085485 9789 ts_tablet_manager.cc:1918] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:15.085872 9789 log.cc:1196] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:15.086629 9789 ts_tablet_manager.cc:1939] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:15.089310 8345 raft_consensus.cc:2454] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:15.093007 8636 tablet_bootstrap.cc:492] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:15.071079 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2b4ef63a53540e6be590243b1d27330" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:15.101182 8107 consensus_peers.cc:487] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:15.102087 8108 leader_election.cc:302] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:15.102902 9838 raft_consensus.cc:2781] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:15.103247 9838 raft_consensus.cc:482] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:15.103580 9838 raft_consensus.cc:3037] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.106366 9810 raft_consensus.cc:2781] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:15.106855 9810 raft_consensus.cc:686] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:15.107674 9810 consensus_queue.cc:237] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.118149 9838 raft_consensus.cc:504] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.120026 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bdb7cce923c4ed98e400c121b6237ba" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:15.121379 9833 consensus_queue.cc:1035] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:15.121547 9809 raft_consensus.cc:482] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:15.121667 8107 leader_election.cc:341] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.122380 8636 ts_tablet_manager.cc:1397] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.462s user 0.010s sys 0.006s
I20260812 19:27:15.122071 9809 raft_consensus.cc:504] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:15.125988 8446 consensus_peers.cc:487] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a84bf28a3e174f3b88f8758b09ced1f1. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:15.126247 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2b4ef63a53540e6be590243b1d27330" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:15.126416 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 48681.1us
W20260812 19:27:15.127820 8107 leader_election.cc:341] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:15.129480 8107 leader_election.cc:341] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.131541 9482 ts_tablet_manager.cc:1918] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:15.125655 9838 leader_election.cc:288] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:15.157347 9482 log.cc:1196] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:15.158847 9482 ts_tablet_manager.cc:1939] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:15.159698 9768 ts_tablet_manager.cc:1918] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:27:15.193081 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2b4ef63a53540e6be590243b1d27330" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:15.193909 8345 raft_consensus.cc:3037] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.160194 9768 log.cc:1196] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/7d660422701a423794416b01cea825b4
I20260812 19:27:15.202661 8636 raft_consensus.cc:348] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:15.203088 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 263) took 1582 ms. Trace:
I20260812 19:27:15.203429 8636 raft_consensus.cc:374] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.203727 8636 raft_consensus.cc:729] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.203474 9789 rpcz_store.cc:276] 0812 19:27:13.621065 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.621167 (+ 102us) service_pool.cc:227] Handling call
0812 19:27:14.932663 (+1311496us) ts_tablet_manager.cc:1145] Deleting tablet 5bce01fd81f04f23a8cddc3a7b5eae8f
0812 19:27:14.932713 (+ 50us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.073626 (+140913us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.085258 (+ 11632us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.203016 (+117758us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1311019}
I20260812 19:27:15.204658 9809 leader_election.cc:288] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:15.204397 8636 consensus_queue.cc:260] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:15.205647 8345 raft_consensus.cc:2454] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:15.208395 8636 ts_tablet_manager.cc:1428] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.086s user 0.006s sys 0.001s
I20260812 19:27:15.208519 9768 ts_tablet_manager.cc:1939] T 7d660422701a423794416b01cea825b4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:15.209807 8636 tablet_bootstrap.cc:492] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:15.210363 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:15.161569 8511 raft_consensus.cc:3037] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.213546 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f57f252b520945328fdaaa9adef593a1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:15.213771 8108 leader_election.cc:302] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:15.215866 9810 raft_consensus.cc:2781] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:15.216375 9810 raft_consensus.cc:686] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:15.219583 9810 consensus_queue.cc:237] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.233168 8446 leader_election.cc:302] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:15.235632 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 272) took 8302 ms. Trace:
I20260812 19:27:15.236040 9482 rpcz_store.cc:276] 0812 19:27:06.933537 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.933680 (+ 143us) service_pool.cc:227] Handling call
0812 19:27:14.631107 (+7697427us) ts_tablet_manager.cc:1145] Deleting tablet 5bce01fd81f04f23a8cddc3a7b5eae8f
0812 19:27:14.631161 (+ 54us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.971269 (+340108us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.131312 (+160043us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.235574 (+104262us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":7689054}
I20260812 19:27:15.237413 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 273) took 8302 ms. Trace:
I20260812 19:27:15.237772 9482 rpcz_store.cc:276] 0812 19:27:06.935329 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:06.936865 (+ 1536us) service_pool.cc:227] Handling call
0812 19:27:15.237109 (+8300244us) ts_tablet_manager.cc:1145] Deleting tablet df369d3c4e004c29ac65c5ecf7f8c4cc
0812 19:27:15.237169 (+ 60us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.237366 (+ 197us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":8294862}
I20260812 19:27:15.241214 8627 tablet_bootstrap.cc:492] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:15.241690 8627 ts_tablet_manager.cc:1397] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.166s user 0.014s sys 0.004s
I20260812 19:27:15.246580 8627 raft_consensus.cc:348] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.247500 8627 raft_consensus.cc:374] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.247807 8627 raft_consensus.cc:729] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.252238 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 288) took 5508 ms. Trace:
I20260812 19:27:15.252633 9482 rpcz_store.cc:276] 0812 19:27:09.744198 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:09.757889 (+ 13691us) service_pool.cc:227] Handling call
0812 19:27:15.239406 (+5481517us) ts_tablet_manager.cc:1145] Deleting tablet 613763d1b3074766bee2d026de516065
0812 19:27:15.239445 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.252171 (+ 12726us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":5480497}
I20260812 19:27:15.254024 9764 raft_consensus.cc:2726] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:15.254514 9482 tablet_replica.cc:330] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:15.255601 9482 raft_consensus.cc:2229] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:15.256421 9482 raft_consensus.cc:2258] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:15.258486 9482 ts_tablet_manager.cc:1905] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:15.264421 9768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 247) took 1868 ms. Trace:
I20260812 19:27:15.264842 9768 rpcz_store.cc:276] 0812 19:27:13.395984 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.405173 (+ 9189us) service_pool.cc:227] Handling call
0812 19:27:14.744690 (+1339517us) ts_tablet_manager.cc:1145] Deleting tablet 7d660422701a423794416b01cea825b4
0812 19:27:14.744764 (+ 74us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:14.932309 (+187545us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.159355 (+227046us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.264299 (+104944us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":1338911}
I20260812 19:27:15.266346 9768 tablet_replica.cc:330] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:15.269018 9767 raft_consensus.cc:2726] T f57f252b520945328fdaaa9adef593a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:15.272469 9849 log.cc:924] Time spent T 384506029b4e49639f87f6d7005fa0a9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.104s user 0.000s sys 0.001s
I20260812 19:27:15.279089 8636 tablet_bootstrap.cc:654] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.282825 9789 tablet_replica.cc:330] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:15.282749 8627 consensus_queue.cc:260] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.294320 9768 raft_consensus.cc:2229] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:15.302609 9768 pending_rounds.cc:62] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Trying to abort 1 pending ops.
I20260812 19:27:15.304802 9768 pending_rounds.cc:68] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Aborting op as it isn't in flight: id { term: 2 index: 1 } timestamp: 7317761366221348864 op_type: NO_OP noop_request { }
I20260812 19:27:15.310612 9768 raft_consensus.cc:2866] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
W20260812 19:27:15.310565 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.618s (SENT)
I20260812 19:27:15.311070 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:15.314425 9768 raft_consensus.cc:2258] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:15.322423 8636 tablet_bootstrap.cc:492] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:15.322830 8636 ts_tablet_manager.cc:1397] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.113s user 0.005s sys 0.006s
I20260812 19:27:15.331032 8636 raft_consensus.cc:348] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.331707 8636 raft_consensus.cc:374] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.331966 8636 raft_consensus.cc:729] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.332896 9690 raft_consensus.cc:482] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:15.336805 9690 raft_consensus.cc:504] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.338811 9690 leader_election.cc:288] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:15.278580 8623 tablet_bootstrap.cc:492] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:15.340183 8623 ts_tablet_manager.cc:1397] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.275s user 0.008s sys 0.008s
I20260812 19:27:15.335031 9834 consensus_queue.cc:1035] T f57f252b520945328fdaaa9adef593a1 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260812 19:27:15.344213 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f7febfc2dcc4ec7a164485dbd6cac8b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:15.347549 8278 leader_election.cc:341] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.349651 8636 consensus_queue.cc:260] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.357053 9789 raft_consensus.cc:2229] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:15.357625 9789 raft_consensus.cc:2258] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:15.359683 9789 ts_tablet_manager.cc:1905] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:15.369514 8627 ts_tablet_manager.cc:1428] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.127s user 0.005s sys 0.000s
I20260812 19:27:15.349637 9867 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:27:15.378350 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f7febfc2dcc4ec7a164485dbd6cac8b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:15.379997 9768 ts_tablet_manager.cc:1905] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:15.382522 8623 raft_consensus.cc:348] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.383270 8623 raft_consensus.cc:374] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.383519 8623 raft_consensus.cc:729] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.384070 8623 consensus_queue.cc:260] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.390964 8182 raft_consensus.cc:2454] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:15.392773 8281 leader_election.cc:302] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:15.394009 9810 consensus_queue.cc:1035] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:15.398566 9790 raft_consensus.cc:2781] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:15.399124 9790 raft_consensus.cc:482] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:15.399696 9790 raft_consensus.cc:3037] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.409394 8636 ts_tablet_manager.cc:1428] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.086s user 0.007s sys 0.001s
I20260812 19:27:15.417626 8627 tablet_bootstrap.cc:492] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:15.415472 9786 consensus_queue.cc:1035] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260812 19:27:15.418864 9842 raft_consensus.cc:482] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:15.410815 8623 ts_tablet_manager.cc:1428] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.070s user 0.007s sys 0.000s
I20260812 19:27:15.434403 9834 raft_consensus.cc:482] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:15.435148 9834 raft_consensus.cc:504] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.441174 8636 tablet_bootstrap.cc:492] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:15.439023 9842 raft_consensus.cc:504] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:15.448472 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:15.454047 8278 leader_election.cc:341] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.454643 8623 tablet_bootstrap.cc:492] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:15.468029 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 968eb13e27ea4f93a45aad17110b0ee4 consensus state has no leader
I20260812 19:27:15.475071 9842 leader_election.cc:288] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:15.465307 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:15.478979 9834 leader_election.cc:288] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:15.479907 9790 raft_consensus.cc:504] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.497575 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14f1198fb9b646b5ae473cfbdfcd7a8d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:15.504076 8446 leader_election.cc:302] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:15.505612 9842 raft_consensus.cc:2726] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:15.507690 9482 ts_tablet_manager.cc:1918] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:15.508036 9482 log.cc:1196] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/04d56a12f8964d4a9ccbc5f870b89713
I20260812 19:27:15.521812 9868 consensus_queue.cc:1035] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:15.535842 9482 ts_tablet_manager.cc:1939] T 04d56a12f8964d4a9ccbc5f870b89713 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:15.535992 9790 leader_election.cc:288] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:15.537904 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f7febfc2dcc4ec7a164485dbd6cac8b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:15.539985 8278 leader_election.cc:341] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.546754 9768 ts_tablet_manager.cc:1918] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.1
I20260812 19:27:15.547247 9768 log.cc:1196] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/a84bf28a3e174f3b88f8758b09ced1f1
I20260812 19:27:15.548151 9768 ts_tablet_manager.cc:1939] T a84bf28a3e174f3b88f8758b09ced1f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:15.551059 9768 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44966 (request call id 246) took 2155 ms. Trace:
I20260812 19:27:15.551508 9768 rpcz_store.cc:276] 0812 19:27:13.395706 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.409540 (+ 13834us) service_pool.cc:227] Handling call
0812 19:27:15.266096 (+1856556us) ts_tablet_manager.cc:1145] Deleting tablet a84bf28a3e174f3b88f8758b09ced1f1
0812 19:27:15.266200 (+ 104us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.537750 (+271550us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.546460 (+ 8710us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.550974 (+ 4514us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7068,"tablet-delete.queue_time_us":1853292}
I20260812 19:27:15.565985 8627 tablet_bootstrap.cc:654] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.533653 9810 raft_consensus.cc:482] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:15.619513 8623 tablet_bootstrap.cc:654] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.630291 8636 tablet_bootstrap.cc:654] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.622494 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4f7febfc2dcc4ec7a164485dbd6cac8b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:15.646063 8178 raft_consensus.cc:3037] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.570080 9810 raft_consensus.cc:504] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.649714 9810 leader_election.cc:288] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:15.630502 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:15.654683 8177 raft_consensus.cc:2454] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:15.654682 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:15.631680 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 295) took 2690 ms. Trace:
I20260812 19:27:15.655296 8345 raft_consensus.cc:2454] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:15.655763 9482 rpcz_store.cc:276] 0812 19:27:12.941363 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:12.941528 (+ 165us) service_pool.cc:227] Handling call
0812 19:27:15.254270 (+2312742us) ts_tablet_manager.cc:1145] Deleting tablet 04d56a12f8964d4a9ccbc5f870b89713
0812 19:27:15.254311 (+ 41us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.417477 (+163166us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.507460 (+ 89983us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.631617 (+124157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33800,"tablet-delete.queue_time_us":2312077}
I20260812 19:27:15.657379 8281 leader_election.cc:302] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:15.658074 9868 raft_consensus.cc:2781] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:15.658397 9868 raft_consensus.cc:482] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:15.658694 9868 raft_consensus.cc:3037] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.658787 8108 leader_election.cc:302] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:15.660310 9810 raft_consensus.cc:2781] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:15.660661 9810 raft_consensus.cc:482] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:15.660995 9810 raft_consensus.cc:3037] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.671042 9868 raft_consensus.cc:504] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.673454 9868 leader_election.cc:288] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:15.675549 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 296) took 2722 ms. Trace:
I20260812 19:27:15.675958 9482 rpcz_store.cc:276] 0812 19:27:12.953347 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:12.953479 (+ 132us) service_pool.cc:227] Handling call
0812 19:27:15.656846 (+2703367us) ts_tablet_manager.cc:1145] Deleting tablet 94407c13a91c4a76bd3aa1c1c8032384
0812 19:27:15.675187 (+ 18341us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.675450 (+ 263us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2702712}
I20260812 19:27:15.676479 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:15.675420 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:15.677170 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 304) took 2550 ms. Trace:
I20260812 19:27:15.677464 9482 rpcz_store.cc:276] 0812 19:27:13.126857 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.127017 (+ 160us) service_pool.cc:227] Handling call
0812 19:27:15.676933 (+2549916us) ts_tablet_manager.cc:1145] Deleting tablet 7d660422701a423794416b01cea825b4
0812 19:27:15.676972 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.677118 (+ 146us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2543083}
I20260812 19:27:15.678445 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 308) took 2499 ms. Trace:
I20260812 19:27:15.678735 9482 rpcz_store.cc:276] 0812 19:27:13.178873 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.179029 (+ 156us) service_pool.cc:227] Handling call
0812 19:27:15.678221 (+2499192us) ts_tablet_manager.cc:1145] Deleting tablet bc5c4ef0441c49fca31b2fc8a2c9abd4
0812 19:27:15.678258 (+ 37us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.678401 (+ 143us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2498507}
I20260812 19:27:15.680485 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 309) took 2488 ms. Trace:
I20260812 19:27:15.680847 9482 rpcz_store.cc:276] 0812 19:27:13.192399 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.192529 (+ 130us) service_pool.cc:227] Handling call
0812 19:27:15.680235 (+2487706us) ts_tablet_manager.cc:1145] Deleting tablet 249da5c0bd73498bbfc8f41e7513a9d4
0812 19:27:15.680293 (+ 58us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.680442 (+ 149us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2487196}
I20260812 19:27:15.681957 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 310) took 2486 ms. Trace:
W20260812 19:27:15.682120 8107 leader_election.cc:341] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.682304 9482 rpcz_store.cc:276] 0812 19:27:13.195584 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.195708 (+ 124us) service_pool.cc:227] Handling call
0812 19:27:15.681734 (+2486026us) ts_tablet_manager.cc:1145] Deleting tablet 863e7ca808f54a989b3372aa4bfe361e
0812 19:27:15.681773 (+ 39us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.681915 (+ 142us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2485542}
I20260812 19:27:15.683374 9482 tablet_replica.cc:330] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:15.695734 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:15.698060 8278 leader_election.cc:341] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.711462 8178 raft_consensus.cc:2454] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:15.713029 8623 tablet_bootstrap.cc:492] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:15.713471 8623 ts_tablet_manager.cc:1397] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.259s user 0.010s sys 0.003s
I20260812 19:27:15.713368 8281 leader_election.cc:302] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:15.714609 9834 raft_consensus.cc:2781] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:15.715134 9834 raft_consensus.cc:686] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:15.716014 9834 consensus_queue.cc:237] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.726334 9810 raft_consensus.cc:504] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.741230 8636 tablet_bootstrap.cc:492] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:15.741655 8636 ts_tablet_manager.cc:1397] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.301s user 0.005s sys 0.009s
I20260812 19:27:15.754114 9789 ts_tablet_manager.cc:1918] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:15.754647 9789 log.cc:1196] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/df369d3c4e004c29ac65c5ecf7f8c4cc
I20260812 19:27:15.756464 8177 raft_consensus.cc:2379] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:15.759419 8281 leader_election.cc:302] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:15.761080 8627 tablet_bootstrap.cc:492] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:15.761502 8627 ts_tablet_manager.cc:1397] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.344s user 0.003s sys 0.014s
I20260812 19:27:15.761000 9834 raft_consensus.cc:2726] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:15.750097 8636 raft_consensus.cc:348] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.749591 8623 raft_consensus.cc:348] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.771311 8623 raft_consensus.cc:374] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.771428 9834 raft_consensus.cc:482] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:15.771607 8623 raft_consensus.cc:729] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.772045 9834 raft_consensus.cc:504] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:15.772274 8623 consensus_queue.cc:260] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.775050 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d07516dc1c4193b4cbd68185f92891" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:15.775784 8177 raft_consensus.cc:2454] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:15.775789 8627 raft_consensus.cc:348] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.768559 8636 raft_consensus.cc:374] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.777256 8281 leader_election.cc:302] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:15.778033 9659 raft_consensus.cc:2781] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:15.778357 9659 raft_consensus.cc:482] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:15.778676 9659 raft_consensus.cc:3037] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.772818 9789 ts_tablet_manager.cc:1939] T df369d3c4e004c29ac65c5ecf7f8c4cc P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:15.776481 8627 raft_consensus.cc:374] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:15.782735 8627 raft_consensus.cc:729] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:27:15.783396 9360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.737s (SENT)
I20260812 19:27:15.787081 9659 raft_consensus.cc:504] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:15.778898 8636 raft_consensus.cc:729] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:15.792553 9667 consensus_queue.cc:1035] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:15.798566 8511 raft_consensus.cc:3037] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.804191 8627 consensus_queue.cc:260] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.808241 9616 consensus_queue.cc:1035] T e67867b6cb864b47ba7b115e12cddb17 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:15.809955 9842 raft_consensus.cc:482] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:15.810427 9842 raft_consensus.cc:504] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.815153 8636 consensus_queue.cc:260] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.817375 8636 ts_tablet_manager.cc:1428] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.075s user 0.009s sys 0.000s
I20260812 19:27:15.817540 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:15.817238 9842 leader_election.cc:288] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:15.818328 8636 tablet_bootstrap.cc:492] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:15.819844 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:15.820660 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e67867b6cb864b47ba7b115e12cddb17" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:15.821136 8107 leader_election.cc:341] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.822161 8446 leader_election.cc:302] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:15.823278 9842 raft_consensus.cc:2726] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:15.827441 8517 raft_consensus.cc:3037] T 14f1198fb9b646b5ae473cfbdfcd7a8d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.832821 8623 ts_tablet_manager.cc:1428] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.104s user 0.007s sys 0.000s
I20260812 19:27:15.839506 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:15.840288 8354 raft_consensus.cc:2379] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:15.841497 8108 leader_election.cc:302] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:15.844488 9667 raft_consensus.cc:2726] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:15.845331 8623 tablet_bootstrap.cc:492] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:15.849902 9482 raft_consensus.cc:2229] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:15.850425 9482 raft_consensus.cc:2258] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:15.852392 9482 ts_tablet_manager.cc:1905] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:15.853698 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 264) took 2231 ms. Trace:
I20260812 19:27:15.854527 9659 leader_election.cc:288] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:15.856057 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d07516dc1c4193b4cbd68185f92891" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:15.856693 8178 raft_consensus.cc:3037] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.860388 9810 leader_election.cc:288] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:15.862913 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d07516dc1c4193b4cbd68185f92891" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:15.864224 8278 leader_election.cc:341] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.868757 9790 consensus_queue.cc:1035] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:15.854735 9789 rpcz_store.cc:276] 0812 19:27:13.622009 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.622206 (+ 197us) service_pool.cc:227] Handling call
0812 19:27:15.241059 (+1618853us) ts_tablet_manager.cc:1145] Deleting tablet df369d3c4e004c29ac65c5ecf7f8c4cc
0812 19:27:15.243997 (+ 2938us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.548922 (+304925us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.753857 (+204935us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.853614 (+ 99757us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":73112,"tablet-delete.queue_time_us":1615715}
I20260812 19:27:15.872406 9789 tablet_replica.cc:330] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
W20260812 19:27:15.885600 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 102206us
I20260812 19:27:15.887297 8627 ts_tablet_manager.cc:1428] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.125s user 0.004s sys 0.002s
I20260812 19:27:15.893325 8627 tablet_bootstrap.cc:492] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:15.908887 8178 raft_consensus.cc:2454] T b4d07516dc1c4193b4cbd68185f92891 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:15.910091 9834 leader_election.cc:288] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:15.910811 8281 leader_election.cc:302] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:15.911887 9834 raft_consensus.cc:2781] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:15.912412 9834 raft_consensus.cc:686] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:15.913275 9834 consensus_queue.cc:237] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:15.916473 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4d07516dc1c4193b4cbd68185f92891" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:15.916916 9616 consensus_queue.cc:1035] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:15.917654 8278 leader_election.cc:341] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.924444 9789 raft_consensus.cc:2229] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:15.931340 8623 tablet_bootstrap.cc:654] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.929572 8627 tablet_bootstrap.cc:654] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.929641 9833 raft_consensus.cc:482] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:15.938777 8278 consensus_peers.cc:487] T bdc25879cf7c434b91591a7c7382cdb0 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:15.938639 9833 raft_consensus.cc:504] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:15.940793 9833 leader_election.cc:288] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:15.943181 8412 tablet.cc:2369] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:27:15.943459 9482 ts_tablet_manager.cc:1918] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:15.944075 9482 log.cc:1196] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/7e087bad986b423098a68fa5d05ff17a
I20260812 19:27:15.945851 9482 ts_tablet_manager.cc:1939] T 7e087bad986b423098a68fa5d05ff17a P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:15.946704 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787047cca4ce4c6884ce5bd07a93f077" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:15.954725 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787047cca4ce4c6884ce5bd07a93f077" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:15.955526 8178 raft_consensus.cc:2454] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:15.956967 8281 leader_election.cc:302] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:15.957830 9790 raft_consensus.cc:2781] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:15.958256 9790 raft_consensus.cc:482] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:15.958674 9790 raft_consensus.cc:3037] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:15.958932 8636 tablet_bootstrap.cc:654] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:15.961192 9789 raft_consensus.cc:2258] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:15.962581 8278 leader_election.cc:341] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:15.964743 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 313) took 2636 ms. Trace:
I20260812 19:27:15.965142 9482 rpcz_store.cc:276] 0812 19:27:13.328763 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.328917 (+ 154us) service_pool.cc:227] Handling call
0812 19:27:15.683241 (+2354324us) ts_tablet_manager.cc:1145] Deleting tablet 7e087bad986b423098a68fa5d05ff17a
0812 19:27:15.683277 (+ 36us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:15.859805 (+176528us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.935892 (+ 76087us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:15.964662 (+ 28770us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":180381,"tablet-delete.queue_time_us":2353732}
I20260812 19:27:15.966454 9482 tablet_replica.cc:330] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:15.991389 8627 tablet_bootstrap.cc:492] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:15.991920 8627 ts_tablet_manager.cc:1397] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.099s user 0.013s sys 0.000s
I20260812 19:27:16.002534 9482 raft_consensus.cc:2229] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:16.008538 9482 raft_consensus.cc:2258] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:16.015707 9482 ts_tablet_manager.cc:1905] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:16.000223 8627 raft_consensus.cc:348] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.017334 8627 raft_consensus.cc:374] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.017590 8627 raft_consensus.cc:729] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:27:16.026476 8443 consensus_peers.cc:487] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:16.025633 8627 consensus_queue.cc:260] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.020932 8623 tablet_bootstrap.cc:492] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
W20260812 19:27:16.022536 8107 consensus_peers.cc:487] T 9bdb7cce923c4ed98e400c121b6237ba P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:16.054103 8623 ts_tablet_manager.cc:1397] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.209s user 0.012s sys 0.002s
I20260812 19:27:16.057322 8623 raft_consensus.cc:348] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.058061 8623 raft_consensus.cc:374] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.058357 8623 raft_consensus.cc:729] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.059010 8623 consensus_queue.cc:260] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.061233 8623 ts_tablet_manager.cc:1428] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20260812 19:27:16.003597 9789 ts_tablet_manager.cc:1905] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:16.059746 9790 raft_consensus.cc:504] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.070845 9790 leader_election.cc:288] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:16.071679 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787047cca4ce4c6884ce5bd07a93f077" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:16.071873 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "787047cca4ce4c6884ce5bd07a93f077" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:16.072403 8178 raft_consensus.cc:3037] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:16.072486 8627 ts_tablet_manager.cc:1428] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.076s user 0.002s sys 0.005s
I20260812 19:27:16.073380 8627 tablet_bootstrap.cc:492] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:16.080360 8178 raft_consensus.cc:2454] T 787047cca4ce4c6884ce5bd07a93f077 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
W20260812 19:27:16.081588 8278 leader_election.cc:341] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:16.082166 8281 leader_election.cc:302] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:16.085909 9833 raft_consensus.cc:2781] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:16.086467 9833 raft_consensus.cc:686] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:16.087291 9833 consensus_queue.cc:237] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:16.094468 9890 log.cc:924] Time spent T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.105s user 0.001s sys 0.000s
I20260812 19:27:16.111011 8627 tablet_bootstrap.cc:654] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.116575 8623 tablet_bootstrap.cc:492] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:16.121805 8623 tablet_bootstrap.cc:654] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.129580 8636 tablet_bootstrap.cc:492] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:16.130023 8636 ts_tablet_manager.cc:1397] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.312s user 0.010s sys 0.000s
I20260812 19:27:16.159327 8636 raft_consensus.cc:348] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.161124 8636 raft_consensus.cc:374] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.162920 8636 raft_consensus.cc:729] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.163551 8636 consensus_queue.cc:260] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.188409 9767 raft_consensus.cc:482] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:16.188895 9767 raft_consensus.cc:504] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.190809 9767 leader_election.cc:288] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:16.198310 8636 ts_tablet_manager.cc:1428] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.068s user 0.007s sys 0.000s
I20260812 19:27:16.203161 8636 tablet_bootstrap.cc:492] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:16.205689 8517 raft_consensus.cc:3037] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:16.217268 9482 ts_tablet_manager.cc:1918] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:16.217799 9482 log.cc:1196] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/2b04529031f04302846b39d585d74ad5
I20260812 19:27:16.218559 9482 ts_tablet_manager.cc:1939] T 2b04529031f04302846b39d585d74ad5 P 6a95b50ceede4dc99913aec28ddaa380: Deleting consensus metadata
I20260812 19:27:16.217412 8623 tablet_bootstrap.cc:492] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:16.220515 8623 ts_tablet_manager.cc:1397] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.104s user 0.009s sys 0.000s
I20260812 19:27:16.228662 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:16.229439 8345 raft_consensus.cc:2379] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:16.231758 9667 consensus_queue.cc:1035] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260812 19:27:16.241521 9616 consensus_queue.cc:1035] T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:16.247056 8636 tablet_bootstrap.cc:654] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.247520 8623 raft_consensus.cc:348] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.248211 8623 raft_consensus.cc:374] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.248481 8623 raft_consensus.cc:729] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.249042 8623 consensus_queue.cc:260] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.247645 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:16.252584 8178 raft_consensus.cc:2379] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:16.252738 8623 ts_tablet_manager.cc:1428] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260812 19:27:16.253767 8623 tablet_bootstrap.cc:492] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:16.253803 8446 leader_election.cc:302] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:16.256552 9767 raft_consensus.cc:3037] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:16.271468 9767 raft_consensus.cc:2726] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:16.276927 8623 tablet_bootstrap.cc:654] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.277166 9482 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:33126 (request call id 312) took 2948 ms. Trace:
I20260812 19:27:16.277763 9482 rpcz_store.cc:276] 0812 19:27:13.328485 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.334038 (+ 5553us) service_pool.cc:227] Handling call
0812 19:27:15.966311 (+2632273us) ts_tablet_manager.cc:1145] Deleting tablet 2b04529031f04302846b39d585d74ad5
0812 19:27:15.966353 (+ 42us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:16.089658 (+123305us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:16.217032 (+127374us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:16.277100 (+ 60068us) inbound_call.cc:173] Queueing success response
Metrics: {"tablet-delete.queue_time_us":2631689}
I20260812 19:27:16.300081 9810 raft_consensus.cc:482] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:16.300603 9810 raft_consensus.cc:504] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.305544 9810 leader_election.cc:288] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:16.309433 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41e6528b71e4d35a6aee94bb7dd7a57" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:16.310750 8107 leader_election.cc:341] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:16.317649 9905 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:16.318382 9905 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:16.332062 8636 tablet_bootstrap.cc:492] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:16.344616 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41e6528b71e4d35a6aee94bb7dd7a57" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:16.345400 8354 raft_consensus.cc:2454] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:16.342348 9659 raft_consensus.cc:482] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:16.347180 8108 leader_election.cc:302] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:16.348182 9837 raft_consensus.cc:2781] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:16.348646 9837 raft_consensus.cc:482] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:16.349017 9837 raft_consensus.cc:3037] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:16.347550 9659 raft_consensus.cc:504] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.354276 9659 leader_election.cc:288] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:16.356660 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d412842c9c4dd0bb47e774d1df8e4b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:16.357292 8178 raft_consensus.cc:2454] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:16.358878 8281 leader_election.cc:302] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:16.358592 9837 raft_consensus.cc:504] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.342510 8636 ts_tablet_manager.cc:1397] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.139s user 0.006s sys 0.007s
I20260812 19:27:16.368706 9659 raft_consensus.cc:2781] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:16.369068 9659 raft_consensus.cc:482] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:16.369383 9659 raft_consensus.cc:3037] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:16.371801 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:16.375178 9905 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
W20260812 19:27:16.379074 8250 tablet.cc:2369] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:27:16.382085 8623 tablet_bootstrap.cc:492] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:16.382503 8623 ts_tablet_manager.cc:1397] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.129s user 0.025s sys 0.029s
I20260812 19:27:16.384794 8623 raft_consensus.cc:348] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:16.385435 8623 raft_consensus.cc:374] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.385674 8623 raft_consensus.cc:729] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.386271 8623 consensus_queue.cc:260] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:16.387727 8623 ts_tablet_manager.cc:1428] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260812 19:27:16.386772 9659 raft_consensus.cc:504] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.398499 9659 leader_election.cc:288] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:16.405401 8627 tablet_bootstrap.cc:492] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:16.409819 8627 ts_tablet_manager.cc:1397] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.336s user 0.011s sys 0.013s
I20260812 19:27:16.412431 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d412842c9c4dd0bb47e774d1df8e4b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:16.413722 8278 leader_election.cc:341] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:16.414067 8575 tablet.cc:2369] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:27:16.414158 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d412842c9c4dd0bb47e774d1df8e4b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:16.415525 8278 leader_election.cc:341] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:16.417642 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d412842c9c4dd0bb47e774d1df8e4b" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:16.420141 8178 raft_consensus.cc:3037] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:16.423466 8281 consensus_peers.cc:487] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e087bad986b423098a68fa5d05ff17a. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:16.437569 8627 raft_consensus.cc:348] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.438382 8627 raft_consensus.cc:374] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.438643 8627 raft_consensus.cc:729] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.439278 8627 consensus_queue.cc:260] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.441463 8627 ts_tablet_manager.cc:1428] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.030s user 0.005s sys 0.001s
I20260812 19:27:16.443732 8627 tablet_bootstrap.cc:492] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:16.448931 8623 tablet_bootstrap.cc:492] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:16.497267 8627 tablet_bootstrap.cc:654] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.503080 9837 leader_election.cc:288] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:16.505285 8623 tablet_bootstrap.cc:654] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:16.509006 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 91712.9us
I20260812 19:27:16.513727 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41e6528b71e4d35a6aee94bb7dd7a57" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:16.515105 8107 leader_election.cc:341] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:16.526516 8636 raft_consensus.cc:348] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.527493 8636 raft_consensus.cc:374] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.527808 8636 raft_consensus.cc:729] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.528575 8636 consensus_queue.cc:260] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.530504 8636 ts_tablet_manager.cc:1428] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.086s user 0.003s sys 0.003s
I20260812 19:27:16.531056 9789 ts_tablet_manager.cc:1918] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:16.531769 9789 log.cc:1196] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/544d3d74baa6477da11abbee139ee66f
I20260812 19:27:16.533078 9789 ts_tablet_manager.cc:1939] T 544d3d74baa6477da11abbee139ee66f P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:16.552928 8627 tablet_bootstrap.cc:492] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:16.553368 8627 ts_tablet_manager.cc:1397] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.110s user 0.012s sys 0.008s
I20260812 19:27:16.560145 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41e6528b71e4d35a6aee94bb7dd7a57" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:16.560715 8354 raft_consensus.cc:3037] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:16.568122 8354 raft_consensus.cc:2454] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:16.571746 8108 leader_election.cc:302] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:16.573808 8636 tablet_bootstrap.cc:492] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:16.583034 8636 tablet_bootstrap.cc:654] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.596870 8636 tablet_bootstrap.cc:492] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:16.597256 8636 ts_tablet_manager.cc:1397] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.024s user 0.002s sys 0.017s
I20260812 19:27:16.552917 9616 raft_consensus.cc:482] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:16.600031 8636 raft_consensus.cc:348] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.600803 8636 raft_consensus.cc:374] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.601044 8636 raft_consensus.cc:729] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.601740 8636 consensus_queue.cc:260] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.604786 8636 ts_tablet_manager.cc:1428] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260812 19:27:16.553122 8178 raft_consensus.cc:2454] T 92d412842c9c4dd0bb47e774d1df8e4b P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:16.609462 8636 tablet_bootstrap.cc:492] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:16.610088 8627 raft_consensus.cc:348] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.610926 8627 raft_consensus.cc:374] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.611224 8627 raft_consensus.cc:729] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.612627 9790 raft_consensus.cc:482] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:16.611907 8627 consensus_queue.cc:260] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.613137 9790 raft_consensus.cc:504] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.615139 8627 ts_tablet_manager.cc:1428] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.062s user 0.006s sys 0.001s
I20260812 19:27:16.616361 8627 tablet_bootstrap.cc:492] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:16.620599 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f522d072cc4ae0a4cc98f1bb88fbc6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:16.627157 9767 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:16.627990 9767 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.631852 9767 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:16.633847 8636 tablet_bootstrap.cc:654] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.632099 8627 tablet_bootstrap.cc:654] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:16.633399 8278 leader_election.cc:341] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:16.636996 8443 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:16.649631 9790 leader_election.cc:288] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:16.656407 8281 leader_election.cc:302] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:16.659066 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f522d072cc4ae0a4cc98f1bb88fbc6" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:16.662365 8281 leader_election.cc:341] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:16.662748 8281 leader_election.cc:302] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:16.608745 9616 raft_consensus.cc:504] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:16.664621 9909 log.cc:924] Time spent T a2b4ef63a53540e6be590243b1d27330 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.113s user 0.001s sys 0.000s
I20260812 19:27:16.676635 8636 tablet_bootstrap.cc:492] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:16.677073 8636 ts_tablet_manager.cc:1397] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.068s user 0.012s sys 0.006s
I20260812 19:27:16.654402 9789 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:44394 (request call id 265) took 3031 ms. Trace:
I20260812 19:27:16.680742 9789 rpcz_store.cc:276] 0812 19:27:13.623130 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.623225 (+ 95us) service_pool.cc:227] Handling call
0812 19:27:15.871590 (+2248365us) ts_tablet_manager.cc:1145] Deleting tablet 544d3d74baa6477da11abbee139ee66f
0812 19:27:15.871814 (+ 224us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0812 19:27:16.235405 (+363591us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:16.399836 (+164431us) tablet_metadata.cc:641] Metadata flushed
0812 19:27:16.654336 (+254500us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50057,"tablet-delete.queue_time_us":2247629}
I20260812 19:27:16.661613 9910 raft_consensus.cc:2781] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:16.682403 8636 raft_consensus.cc:348] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.683076 8636 raft_consensus.cc:374] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.683313 8636 raft_consensus.cc:729] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.682991 9910 raft_consensus.cc:686] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:16.683934 8636 consensus_queue.cc:260] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.684679 9910 consensus_queue.cc:237] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.698448 9616 leader_election.cc:288] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:16.702129 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067fdfc16a7e44c2b3dac5fe262a5728" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:16.703302 9667 raft_consensus.cc:482] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:16.705687 8107 leader_election.cc:341] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:16.708884 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 46538.3us
I20260812 19:27:16.709692 9659 raft_consensus.cc:2726] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:16.722966 8636 ts_tablet_manager.cc:1428] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.046s user 0.009s sys 0.000s
I20260812 19:27:16.724144 8636 tablet_bootstrap.cc:492] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:16.724674 9790 raft_consensus.cc:2781] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:16.725378 9790 raft_consensus.cc:686] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:16.726825 9790 consensus_queue.cc:237] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.703737 9667 raft_consensus.cc:504] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.745591 8627 tablet_bootstrap.cc:492] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:16.746227 8627 ts_tablet_manager.cc:1397] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.130s user 0.015s sys 0.016s
I20260812 19:27:16.747006 9767 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:16.747885 9767 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:16.749577 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.737s (SENT)
I20260812 19:27:16.750711 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:16.756620 8627 raft_consensus.cc:348] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:16.756812 8443 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:16.757328 8627 raft_consensus.cc:374] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.757581 8627 raft_consensus.cc:729] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.758186 8627 consensus_queue.cc:260] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:16.761471 8627 ts_tablet_manager.cc:1428] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260812 19:27:16.763636 9767 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:16.764572 8636 tablet_bootstrap.cc:654] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.767616 8627 tablet_bootstrap.cc:492] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:16.784678 8627 tablet_bootstrap.cc:654] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.799681 8627 tablet_bootstrap.cc:492] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:16.801926 8627 ts_tablet_manager.cc:1397] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.035s user 0.020s sys 0.007s
W20260812 19:27:16.804247 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 55650.9us
I20260812 19:27:16.811498 9922 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:27:16.805696 8627 raft_consensus.cc:348] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.830343 8627 raft_consensus.cc:374] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.830636 8627 raft_consensus.cc:729] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.832516 8627 consensus_queue.cc:260] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.834677 8627 ts_tablet_manager.cc:1428] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.032s user 0.006s sys 0.000s
I20260812 19:27:16.835577 8627 tablet_bootstrap.cc:492] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:16.849483 8627 tablet_bootstrap.cc:654] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:16.850178 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 278493us
I20260812 19:27:16.853698 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067fdfc16a7e44c2b3dac5fe262a5728" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:16.854231 8354 raft_consensus.cc:2454] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:16.873775 8627 tablet_bootstrap.cc:492] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:16.874281 8627 ts_tablet_manager.cc:1397] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.039s user 0.012s sys 0.004s
I20260812 19:27:16.876752 8636 tablet_bootstrap.cc:492] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:16.877269 8636 ts_tablet_manager.cc:1397] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.153s user 0.007s sys 0.011s
I20260812 19:27:16.877609 8627 raft_consensus.cc:348] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.878422 8627 raft_consensus.cc:374] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.878738 8627 raft_consensus.cc:729] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.879925 8627 consensus_queue.cc:260] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.887154 8636 raft_consensus.cc:348] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:16.887892 8636 raft_consensus.cc:374] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.890895 9790 consensus_queue.cc:1035] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:16.893180 7948 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet e67867b6cb864b47ba7b115e12cddb17 (table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet e67867b6cb864b47ba7b115e12cddb17 consensus state has no leader
I20260812 19:27:16.899681 8627 ts_tablet_manager.cc:1428] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260812 19:27:16.900633 8627 tablet_bootstrap.cc:492] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:16.903218 9667 leader_election.cc:288] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:16.906236 8627 tablet_bootstrap.cc:654] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.888176 8636 raft_consensus.cc:729] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.921335 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfbf700d55a04b529507259406bdd5a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:16.922565 8107 leader_election.cc:341] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:16.928331 9659 consensus_queue.cc:1035] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:16.929690 9659 consensus_queue.cc:1035] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:16.941399 8627 tablet_bootstrap.cc:492] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:16.941874 8627 ts_tablet_manager.cc:1397] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.041s user 0.012s sys 0.003s
I20260812 19:27:16.944193 8627 raft_consensus.cc:348] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.950641 8627 raft_consensus.cc:374] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:16.950897 8627 raft_consensus.cc:729] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:16.951412 8517 raft_consensus.cc:3037] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:16.951460 8627 consensus_queue.cc:260] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:16.953486 8627 ts_tablet_manager.cc:1428] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20260812 19:27:16.954312 8627 tablet_bootstrap.cc:492] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:16.922374 8636 consensus_queue.cc:260] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:16.969930 8278 consensus_peers.cc:487] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:16.979553 8108 leader_election.cc:302] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
W20260812 19:27:16.982566 8446 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:16.983038 8446 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:16.983783 9767 raft_consensus.cc:2726] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:16.985482 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfbf700d55a04b529507259406bdd5a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:16.986034 8354 raft_consensus.cc:2454] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:27:16.995965 8446 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:16.996488 8446 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:16.997376 9767 raft_consensus.cc:2726] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:17.001153 8509 raft_consensus.cc:3037] T bdc25879cf7c434b91591a7c7382cdb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.013314 8627 tablet_bootstrap.cc:654] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:16.980433 9929 raft_consensus.cc:2781] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.036571 9929 raft_consensus.cc:482] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.036926 9929 raft_consensus.cc:3037] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.046746 8108 leader_election.cc:302] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:17.048519 9916 raft_consensus.cc:2781] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:17.048879 9916 raft_consensus.cc:482] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:17.049197 9916 raft_consensus.cc:3037] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.048993 8636 ts_tablet_manager.cc:1428] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.171s user 0.012s sys 0.000s
I20260812 19:27:17.061275 9833 consensus_queue.cc:1035] T 4f7febfc2dcc4ec7a164485dbd6cac8b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:17.085625 8514 raft_consensus.cc:3037] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.085727 9916 raft_consensus.cc:504] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:17.109037 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 105019us
I20260812 19:27:17.120882 9921 consensus_queue.cc:1035] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:17.130016 8627 tablet_bootstrap.cc:492] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:17.130420 8627 ts_tablet_manager.cc:1397] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.176s user 0.010s sys 0.005s
I20260812 19:27:17.132629 8627 raft_consensus.cc:348] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.133520 8627 raft_consensus.cc:374] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.133939 8627 raft_consensus.cc:729] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.134637 8627 consensus_queue.cc:260] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.137195 8627 ts_tablet_manager.cc:1428] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.007s user 0.005s sys 0.003s
I20260812 19:27:17.155736 8636 tablet_bootstrap.cc:492] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:17.185251 8627 tablet_bootstrap.cc:492] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:17.216527 9942 raft_consensus.cc:482] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:17.222273 9943 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:17.222764 9943 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.224660 9943 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:17.217051 9942 raft_consensus.cc:504] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.235108 8627 tablet_bootstrap.cc:654] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:17.241315 8443 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:17.256920 9659 raft_consensus.cc:482] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.257440 9659 raft_consensus.cc:504] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:17.260217 8443 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:17.260319 9659 leader_election.cc:288] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:17.261238 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:17.264645 8446 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:17.265079 8446 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:17.266568 9936 raft_consensus.cc:2726] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:17.270278 9929 raft_consensus.cc:504] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:17.272065 9942 leader_election.cc:288] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:17.272943 8278 leader_election.cc:341] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.273897 8623 tablet_bootstrap.cc:492] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:17.274333 8623 ts_tablet_manager.cc:1397] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.826s user 0.026s sys 0.053s
I20260812 19:27:17.273984 9929 leader_election.cc:288] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:17.276808 8623 raft_consensus.cc:348] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.277443 8623 raft_consensus.cc:374] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.277915 8623 raft_consensus.cc:729] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.278847 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:17.278466 8623 consensus_queue.cc:260] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.281428 8623 ts_tablet_manager.cc:1428] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
I20260812 19:27:17.282395 8623 tablet_bootstrap.cc:492] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:17.282932 8446 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:17.283453 8446 leader_election.cc:302] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:17.287607 9942 raft_consensus.cc:2726] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:17.285439 8636 tablet_bootstrap.cc:654] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.291886 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067fdfc16a7e44c2b3dac5fe262a5728" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:17.292447 8354 raft_consensus.cc:3037] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.299049 8354 raft_consensus.cc:2454] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
W20260812 19:27:17.303360 8281 leader_election.cc:341] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.304159 8108 leader_election.cc:302] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:17.305085 9951 raft_consensus.cc:2781] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.307029 9951 raft_consensus.cc:686] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:17.307924 9951 consensus_queue.cc:237] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:17.312932 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067fdfc16a7e44c2b3dac5fe262a5728" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:17.315563 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfbf700d55a04b529507259406bdd5a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:17.303915 8281 leader_election.cc:302] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:17.318233 9659 raft_consensus.cc:2726] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:17.319572 8107 leader_election.cc:341] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.311957 8511 raft_consensus.cc:3037] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.329002 9916 leader_election.cc:288] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:17.331257 8107 leader_election.cc:341] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.343999 8623 tablet_bootstrap.cc:654] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.351724 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfbf700d55a04b529507259406bdd5a1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:17.352358 8344 raft_consensus.cc:3037] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.359445 8344 raft_consensus.cc:2454] T cfbf700d55a04b529507259406bdd5a1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:17.364658 8627 tablet_bootstrap.cc:492] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:17.365080 8627 ts_tablet_manager.cc:1397] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.180s user 0.007s sys 0.007s
I20260812 19:27:17.367340 8627 raft_consensus.cc:348] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:17.367995 8627 raft_consensus.cc:374] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.368239 8627 raft_consensus.cc:729] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.368815 8627 consensus_queue.cc:260] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:17.369645 8108 leader_election.cc:302] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:17.371057 9929 raft_consensus.cc:2781] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:17.371557 9929 raft_consensus.cc:686] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:17.372649 9929 consensus_queue.cc:237] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.380914 8627 ts_tablet_manager.cc:1428] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.016s user 0.003s sys 0.003s
W20260812 19:27:17.386514 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 47864.5us
I20260812 19:27:17.388978 8627 tablet_bootstrap.cc:492] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:17.396862 8627 tablet_bootstrap.cc:654] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.435343 8627 tablet_bootstrap.cc:492] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:17.435915 8627 ts_tablet_manager.cc:1397] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.047s user 0.008s sys 0.011s
I20260812 19:27:17.440541 8627 raft_consensus.cc:348] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.441483 8627 raft_consensus.cc:374] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.441814 8627 raft_consensus.cc:729] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.442408 8627 consensus_queue.cc:260] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.452943 8627 ts_tablet_manager.cc:1428] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.017s user 0.007s sys 0.004s
I20260812 19:27:17.479090 9790 raft_consensus.cc:482] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.479594 9790 raft_consensus.cc:504] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.485044 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:17.486513 8278 leader_election.cc:341] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.491671 9790 leader_election.cc:288] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:17.494223 8627 tablet_bootstrap.cc:492] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:17.500065 8627 tablet_bootstrap.cc:654] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.503948 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:17.504556 9964 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
W20260812 19:27:17.505575 8281 leader_election.cc:341] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.506199 9964 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:17.510947 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:17.505997 8281 leader_election.cc:302] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:17.510720 9964 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:17.516359 8636 tablet_bootstrap.cc:492] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:17.516850 8636 ts_tablet_manager.cc:1397] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.361s user 0.018s sys 0.000s
I20260812 19:27:17.519896 8627 tablet_bootstrap.cc:492] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:17.520396 8627 ts_tablet_manager.cc:1397] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.003s
I20260812 19:27:17.536818 9921 raft_consensus.cc:2726] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.537756 8627 raft_consensus.cc:348] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.538411 8627 raft_consensus.cc:374] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.538661 8627 raft_consensus.cc:729] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.539222 8627 consensus_queue.cc:260] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.540552 9921 raft_consensus.cc:482] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.541282 8627 ts_tablet_manager.cc:1428] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.021s user 0.001s sys 0.004s
I20260812 19:27:17.540977 9921 raft_consensus.cc:504] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.542176 8627 tablet_bootstrap.cc:492] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:17.546301 9921 leader_election.cc:288] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:17.551502 8627 tablet_bootstrap.cc:654] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.543390 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:17.557298 8278 leader_election.cc:341] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.575634 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:17.580085 8623 tablet_bootstrap.cc:492] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:17.580564 8623 ts_tablet_manager.cc:1397] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.298s user 0.011s sys 0.007s
W20260812 19:27:17.585755 8281 leader_election.cc:341] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.586163 8281 leader_election.cc:302] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:17.602223 9790 raft_consensus.cc:2726] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.560873 8636 raft_consensus.cc:348] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.606532 8636 raft_consensus.cc:374] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.606899 8636 raft_consensus.cc:729] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.583657 8623 raft_consensus.cc:348] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.631755 8623 raft_consensus.cc:374] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.638607 8623 raft_consensus.cc:729] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.639755 8623 consensus_queue.cc:260] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.647110 8636 consensus_queue.cc:260] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.650163 8623 ts_tablet_manager.cc:1428] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.069s user 0.006s sys 0.000s
I20260812 19:27:17.662197 8627 tablet_bootstrap.cc:492] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:17.662736 8627 ts_tablet_manager.cc:1397] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.121s user 0.030s sys 0.025s
I20260812 19:27:17.665175 8627 raft_consensus.cc:348] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.665969 8627 raft_consensus.cc:374] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.666312 8627 raft_consensus.cc:729] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.666996 8627 consensus_queue.cc:260] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.677502 8627 ts_tablet_manager.cc:1428] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260812 19:27:17.679042 8627 tablet_bootstrap.cc:492] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:17.692945 8623 tablet_bootstrap.cc:492] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:17.697649 8636 ts_tablet_manager.cc:1428] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.180s user 0.011s sys 0.000s
I20260812 19:27:17.709161 8623 tablet_bootstrap.cc:654] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:17.715169 8107 consensus_peers.cc:487] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:17.733014 8636 tablet_bootstrap.cc:492] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:17.742663 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.630s (SENT)
I20260812 19:27:17.743098 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:17.745754 8627 tablet_bootstrap.cc:654] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.756187 8623 tablet_bootstrap.cc:492] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:17.756645 8623 ts_tablet_manager.cc:1397] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.064s user 0.012s sys 0.000s
I20260812 19:27:17.758797 8623 raft_consensus.cc:348] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.759441 8623 raft_consensus.cc:374] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.759690 8623 raft_consensus.cc:729] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.760298 8623 consensus_queue.cc:260] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.763111 8623 ts_tablet_manager.cc:1428] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 19:27:17.778208 9921 raft_consensus.cc:482] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.778823 9921 raft_consensus.cc:504] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.783061 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:17.784526 8281 leader_election.cc:341] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.785532 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:17.787097 8278 leader_election.cc:341] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.787569 8278 leader_election.cc:302] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:17.788504 9790 raft_consensus.cc:2726] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:17.789669 9921 leader_election.cc:288] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:17.792450 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 49821.7us
I20260812 19:27:17.791853 9969 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:27:17.799414 8636 tablet_bootstrap.cc:654] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.809008 8623 tablet_bootstrap.cc:492] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:17.814082 8623 tablet_bootstrap.cc:654] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.828154 8623 tablet_bootstrap.cc:492] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:17.828608 8623 ts_tablet_manager.cc:1397] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.000s
I20260812 19:27:17.830928 8623 raft_consensus.cc:348] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.831604 8623 raft_consensus.cc:374] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.831852 8623 raft_consensus.cc:729] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.832748 8623 consensus_queue.cc:260] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.834813 8623 ts_tablet_manager.cc:1428] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 19:27:17.838119 8636 tablet_bootstrap.cc:492] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:17.838532 8636 ts_tablet_manager.cc:1397] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.106s user 0.009s sys 0.002s
I20260812 19:27:17.840736 8623 tablet_bootstrap.cc:492] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:17.846194 8636 raft_consensus.cc:348] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.846952 8636 raft_consensus.cc:374] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.847234 8636 raft_consensus.cc:729] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.847864 8636 consensus_queue.cc:260] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.870215 8636 ts_tablet_manager.cc:1428] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.031s user 0.005s sys 0.001s
I20260812 19:27:17.879983 8623 tablet_bootstrap.cc:654] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.889961 9921 raft_consensus.cc:482] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:17.905784 9921 raft_consensus.cc:504] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:17.893689 8278 consensus_peers.cc:487] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:17.901499 9833 consensus_queue.cc:1035] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:17.929811 8627 tablet_bootstrap.cc:492] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:17.930289 8627 ts_tablet_manager.cc:1397] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.251s user 0.009s sys 0.002s
I20260812 19:27:17.932487 8627 raft_consensus.cc:348] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:17.933303 8627 raft_consensus.cc:374] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:17.933531 8627 raft_consensus.cc:729] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:17.935104 8627 consensus_queue.cc:260] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:17.952339 8511 raft_consensus.cc:3037] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:17.959937 8636 tablet_bootstrap.cc:492] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:17.965727 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:17.967551 8281 leader_election.cc:341] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:17.969934 8636 tablet_bootstrap.cc:654] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:17.970225 8627 ts_tablet_manager.cc:1428] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.040s user 0.005s sys 0.001s
I20260812 19:27:17.981560 8627 tablet_bootstrap.cc:492] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:17.985971 9921 leader_election.cc:288] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:17.987156 9942 raft_consensus.cc:482] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:17.987682 9942 raft_consensus.cc:504] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:17.990154 9942 leader_election.cc:288] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:17.997360 8446 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 2b04529031f04302846b39d585d74ad5
I20260812 19:27:18.001708 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:18.004415 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:18.008579 8443 leader_election.cc:302] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:18.010051 9942 raft_consensus.cc:2726] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:27:18.014067 8278 leader_election.cc:341] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.031230 8278 leader_election.cc:302] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:18.038125 8636 tablet_bootstrap.cc:492] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:18.038582 8636 ts_tablet_manager.cc:1397] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.079s user 0.008s sys 0.008s
I20260812 19:27:18.046952 9915 consensus_queue.cc:1035] T f41e6528b71e4d35a6aee94bb7dd7a57 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.049034 9659 raft_consensus.cc:2726] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:18.014611 9833 raft_consensus.cc:482] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.051384 9833 raft_consensus.cc:504] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.059163 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "354d9912acad4c1ba76f45ce277f1e94" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:18.060834 8281 leader_election.cc:341] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.048369 8636 raft_consensus.cc:348] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.061462 8636 raft_consensus.cc:374] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.061738 8636 raft_consensus.cc:729] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.062368 8636 consensus_queue.cc:260] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.064036 8636 ts_tablet_manager.cc:1428] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.018s user 0.003s sys 0.000s
I20260812 19:27:18.072680 8627 tablet_bootstrap.cc:654] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.074608 8623 tablet_bootstrap.cc:492] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:18.075050 8623 ts_tablet_manager.cc:1397] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.234s user 0.016s sys 0.002s
I20260812 19:27:18.077594 8623 raft_consensus.cc:348] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.078902 8623 raft_consensus.cc:374] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.079208 8623 raft_consensus.cc:729] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.079912 8623 consensus_queue.cc:260] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.081789 8623 ts_tablet_manager.cc:1428] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260812 19:27:18.101991 9833 leader_election.cc:288] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:18.104210 8636 tablet_bootstrap.cc:492] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:18.109575 8636 tablet_bootstrap.cc:654] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.129106 9942 raft_consensus.cc:482] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:18.129916 9942 raft_consensus.cc:504] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.135092 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "354d9912acad4c1ba76f45ce277f1e94" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:18.142253 9942 leader_election.cc:288] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:18.143615 8446 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 544d3d74baa6477da11abbee139ee66f
I20260812 19:27:18.143945 9915 raft_consensus.cc:482] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.144685 9915 raft_consensus.cc:504] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.149115 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:18.150484 8107 leader_election.cc:341] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.151639 9915 leader_election.cc:288] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.154716 8636 tablet_bootstrap.cc:492] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:18.155247 8636 ts_tablet_manager.cc:1397] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.051s user 0.008s sys 0.003s
W20260812 19:27:18.156394 8278 leader_election.cc:341] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.156855 8278 leader_election.cc:302] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:18.157554 9833 raft_consensus.cc:2726] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:18.158677 8636 raft_consensus.cc:348] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.159479 8636 raft_consensus.cc:374] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.159731 8636 raft_consensus.cc:729] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.165292 8636 consensus_queue.cc:260] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.173206 8636 ts_tablet_manager.cc:1428] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.018s user 0.004s sys 0.004s
I20260812 19:27:18.178043 8627 tablet_bootstrap.cc:492] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:18.178464 8627 ts_tablet_manager.cc:1397] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.197s user 0.009s sys 0.001s
I20260812 19:27:18.183243 8636 tablet_bootstrap.cc:492] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:18.189481 8636 tablet_bootstrap.cc:654] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.205623 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:18.206395 8344 raft_consensus.cc:2454] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:18.215881 9952 raft_consensus.cc:482] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:18.216390 9952 raft_consensus.cc:504] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.219588 9952 leader_election.cc:288] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:18.221921 8627 raft_consensus.cc:348] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.222538 8627 raft_consensus.cc:374] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.222796 8627 raft_consensus.cc:729] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:27:18.241644 8281 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 2b04529031f04302846b39d585d74ad5
I20260812 19:27:18.261473 8627 consensus_queue.cc:260] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.263927 8627 ts_tablet_manager.cc:1428] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.085s user 0.003s sys 0.003s
I20260812 19:27:18.268632 9951 raft_consensus.cc:482] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.269614 9951 raft_consensus.cc:504] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.282371 8623 tablet_bootstrap.cc:492] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:18.309758 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b8e6cecfa04aa685014277c15fb6f4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:18.312683 8107 leader_election.cc:341] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.313063 8627 tablet_bootstrap.cc:492] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:18.327385 9915 raft_consensus.cc:482] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.328122 9915 raft_consensus.cc:504] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.330823 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:18.332108 8107 leader_election.cc:341] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.336565 9915 leader_election.cc:288] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.347946 9951 leader_election.cc:288] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.350149 8108 leader_election.cc:302] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:18.353077 9929 raft_consensus.cc:2781] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:18.353456 9929 raft_consensus.cc:482] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:18.353766 9929 raft_consensus.cc:3037] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:18.363884 9988 log.cc:924] Time spent T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.157s user 0.001s sys 0.000s
I20260812 19:27:18.365903 8623 tablet_bootstrap.cc:654] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.367451 9929 raft_consensus.cc:504] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.370745 8627 tablet_bootstrap.cc:654] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.374286 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:18.374913 8517 raft_consensus.cc:2454] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:18.374818 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:18.375779 9929 leader_election.cc:288] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:18.376534 8107 leader_election.cc:341] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:18.386637 8443 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 544d3d74baa6477da11abbee139ee66f
I20260812 19:27:18.387120 8443 leader_election.cc:302] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:18.388594 9977 raft_consensus.cc:2726] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:18.411072 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b8e6cecfa04aa685014277c15fb6f4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:18.412034 8354 raft_consensus.cc:2454] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:18.420907 8511 raft_consensus.cc:3037] T cfbf700d55a04b529507259406bdd5a1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.436148 8627 tablet_bootstrap.cc:492] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:18.436657 8627 ts_tablet_manager.cc:1397] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.124s user 0.007s sys 0.004s
I20260812 19:27:18.439188 8627 raft_consensus.cc:348] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:18.439862 8627 raft_consensus.cc:374] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.440387 9984 raft_consensus.cc:482] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.440933 9984 raft_consensus.cc:504] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:18.441916 8107 consensus_peers.cc:487] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 -> Peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Couldn't send request to peer 4f26a5f8e5934d8d8c026a2d957c78a5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:18.443928 9984 leader_election.cc:288] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.445397 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f522d072cc4ae0a4cc98f1bb88fbc6" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:18.446034 8182 raft_consensus.cc:2454] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:18.448565 9929 consensus_queue.cc:1035] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.449018 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:18.449721 8354 raft_consensus.cc:2454] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:18.450336 8446 leader_election.cc:302] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:18.450587 8636 tablet_bootstrap.cc:492] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:18.451248 9977 raft_consensus.cc:2781] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:18.451560 9977 raft_consensus.cc:482] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:18.451830 9977 raft_consensus.cc:3037] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.440084 8627 raft_consensus.cc:729] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.455010 8627 consensus_queue.cc:260] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:18.450969 8636 ts_tablet_manager.cc:1397] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.268s user 0.016s sys 0.002s
I20260812 19:27:18.457185 8627 ts_tablet_manager.cc:1428] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.020s user 0.006s sys 0.000s
I20260812 19:27:18.458262 8636 raft_consensus.cc:348] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.458887 8636 raft_consensus.cc:374] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.459123 8636 raft_consensus.cc:729] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.461788 9977 raft_consensus.cc:504] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.464665 9977 leader_election.cc:288] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.465444 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f522d072cc4ae0a4cc98f1bb88fbc6" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:18.465236 8636 consensus_queue.cc:260] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.465989 8182 raft_consensus.cc:3037] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.466825 8636 ts_tablet_manager.cc:1428] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.010s user 0.003s sys 0.002s
I20260812 19:27:18.477722 9921 raft_consensus.cc:482] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.478194 9921 raft_consensus.cc:504] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:18.481537 9921 leader_election.cc:288] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:18.495636 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73ea5acf663420cbe9236c014d71199" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:18.497172 8281 leader_election.cc:341] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.498565 9951 raft_consensus.cc:482] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.499012 9951 raft_consensus.cc:504] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.503131 9951 leader_election.cc:288] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.503513 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "354d9912acad4c1ba76f45ce277f1e94" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:18.505376 8182 raft_consensus.cc:2454] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:18.511359 8446 leader_election.cc:302] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:18.504156 8511 raft_consensus.cc:2454] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:18.513335 8107 leader_election.cc:302] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:18.514084 9929 raft_consensus.cc:2781] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:18.514392 9929 raft_consensus.cc:482] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:18.514711 9929 raft_consensus.cc:3037] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.514736 9977 raft_consensus.cc:2781] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:18.515429 9977 raft_consensus.cc:686] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:18.516193 9977 consensus_queue.cc:237] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.526363 9952 raft_consensus.cc:482] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.526857 9952 raft_consensus.cc:504] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.528687 9952 leader_election.cc:288] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:18.530575 8623 tablet_bootstrap.cc:492] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:18.530954 8623 ts_tablet_manager.cc:1397] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.249s user 0.013s sys 0.003s
I20260812 19:27:18.533806 9929 raft_consensus.cc:504] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.534583 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:18.535094 8354 raft_consensus.cc:3037] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.540607 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "354d9912acad4c1ba76f45ce277f1e94" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:18.541167 8509 raft_consensus.cc:3037] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.525851 8636 tablet_bootstrap.cc:492] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:18.547396 8627 tablet_bootstrap.cc:492] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:18.552790 8627 tablet_bootstrap.cc:654] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.554610 8348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "354d9912acad4c1ba76f45ce277f1e94" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:18.555240 8348 raft_consensus.cc:2454] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:18.561888 9952 raft_consensus.cc:482] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.562322 9952 raft_consensus.cc:504] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:18.564555 9952 leader_election.cc:288] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:18.564646 9929 leader_election.cc:288] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.567981 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f3c6d8f74d044948a893d756be9a838" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:18.570526 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:18.572723 8281 leader_election.cc:341] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.572954 8627 tablet_bootstrap.cc:492] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:18.573495 8627 ts_tablet_manager.cc:1397] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.000s
W20260812 19:27:18.573525 8281 leader_election.cc:341] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.560022 10002 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:18.574605 10002 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:18.577962 8627 raft_consensus.cc:348] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:18.578691 8627 raft_consensus.cc:374] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.578970 8627 raft_consensus.cc:729] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.579604 8627 consensus_queue.cc:260] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:18.583232 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:18.560050 8623 raft_consensus.cc:348] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.585518 8623 raft_consensus.cc:374] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.585806 8623 raft_consensus.cc:729] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.586449 8623 consensus_queue.cc:260] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.587538 10002 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
W20260812 19:27:18.608433 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 44244.2us
I20260812 19:27:18.609911 8627 ts_tablet_manager.cc:1428] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.036s user 0.007s sys 0.000s
I20260812 19:27:18.614102 9977 raft_consensus.cc:482] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.614676 9977 raft_consensus.cc:504] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.616765 9977 leader_election.cc:288] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.617929 8627 tablet_bootstrap.cc:492] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:18.624099 8623 ts_tablet_manager.cc:1428] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.093s user 0.010s sys 0.001s
I20260812 19:27:18.628424 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d412842c9c4dd0bb47e774d1df8e4b" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:18.632383 10003 raft_consensus.cc:482] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.640687 10003 raft_consensus.cc:504] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.641717 8636 tablet_bootstrap.cc:654] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.644174 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:18.645812 8107 leader_election.cc:341] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.652697 8627 tablet_bootstrap.cc:654] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.655539 10003 leader_election.cc:288] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.668927 8348 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "354d9912acad4c1ba76f45ce277f1e94" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:18.669570 8348 raft_consensus.cc:3037] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.679571 8354 raft_consensus.cc:2454] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:18.685643 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f522d072cc4ae0a4cc98f1bb88fbc6" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:18.686589 8344 raft_consensus.cc:3037] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.688848 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92d412842c9c4dd0bb47e774d1df8e4b" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:18.691677 9998 consensus_queue.cc:1035] T 067fdfc16a7e44c2b3dac5fe262a5728 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:18.693636 8108 leader_election.cc:302] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:18.694792 9998 raft_consensus.cc:2781] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:18.695124 9998 raft_consensus.cc:482] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:18.695452 9998 raft_consensus.cc:3037] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.704355 8344 raft_consensus.cc:2454] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:18.706777 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73ea5acf663420cbe9236c014d71199" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:18.713572 8108 leader_election.cc:302] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:18.714545 9915 raft_consensus.cc:2781] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:18.714915 9915 raft_consensus.cc:482] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:18.715240 9915 raft_consensus.cc:3037] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.706756 8348 raft_consensus.cc:2454] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:18.721767 9929 consensus_queue.cc:1035] T cfbf700d55a04b529507259406bdd5a1 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:18.725673 9915 raft_consensus.cc:504] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.736546 8623 tablet_bootstrap.cc:492] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:18.739753 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:18.741197 8107 leader_election.cc:341] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.743292 8278 leader_election.cc:302] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:18.744073 8354 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8f522d072cc4ae0a4cc98f1bb88fbc6" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:18.744691 8354 raft_consensus.cc:2362] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1. Re-sending same reply.
I20260812 19:27:18.751044 8627 tablet_bootstrap.cc:492] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:18.751487 8627 ts_tablet_manager.cc:1397] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.134s user 0.011s sys 0.000s
I20260812 19:27:18.742393 9915 leader_election.cc:288] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:18.759167 8108 leader_election.cc:302] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:18.760090 9929 raft_consensus.cc:2781] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:18.760722 9929 raft_consensus.cc:686] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:18.761632 9929 consensus_queue.cc:237] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.772049 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f3c6d8f74d044948a893d756be9a838" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:18.774259 9998 raft_consensus.cc:504] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.774861 8507 raft_consensus.cc:3037] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:18.774849 8509 raft_consensus.cc:2454] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:18.776582 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:18.783493 8636 tablet_bootstrap.cc:492] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:18.776523 8107 leader_election.cc:302] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:18.783949 8636 ts_tablet_manager.cc:1397] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.258s user 0.010s sys 0.005s
I20260812 19:27:18.784559 9915 raft_consensus.cc:2781] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:18.786146 9915 raft_consensus.cc:686] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:18.787941 9915 consensus_queue.cc:237] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.796873 9998 leader_election.cc:288] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:18.797727 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 54502.6us
I20260812 19:27:18.799667 9952 raft_consensus.cc:2781] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:18.800062 9952 raft_consensus.cc:482] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:18.800551 9952 raft_consensus.cc:3037] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:18.804669 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b8e6cecfa04aa685014277c15fb6f4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:18.808754 8107 leader_election.cc:341] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:18.810823 7948 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet 7764a1ae009142b29d5fb574dca45e21 consensus state has no leader
I20260812 19:27:18.787977 8636 raft_consensus.cc:348] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:18.824784 8636 raft_consensus.cc:374] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.825120 8636 raft_consensus.cc:729] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.825872 8636 consensus_queue.cc:260] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:18.847666 8636 ts_tablet_manager.cc:1428] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.063s user 0.006s sys 0.001s
I20260812 19:27:18.864540 8623 tablet_bootstrap.cc:700] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380: Time spent opening tablet: real 0.117s user 0.004s sys 0.000s
I20260812 19:27:18.865298 8623 tablet_bootstrap.cc:654] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:18.870599 8278 leader_election.cc:341] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.871039 8278 leader_election.cc:302] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:18.871706 9921 raft_consensus.cc:2726] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:18.872605 8627 raft_consensus.cc:348] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.873311 8627 raft_consensus.cc:374] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:18.873561 8627 raft_consensus.cc:729] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.874142 8627 consensus_queue.cc:260] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.876076 8627 ts_tablet_manager.cc:1428] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.124s user 0.008s sys 0.000s
I20260812 19:27:18.894310 9952 raft_consensus.cc:504] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:18.896840 9952 leader_election.cc:288] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 2 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:18.898633 8281 leader_election.cc:341] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 2b04529031f04302846b39d585d74ad5
W20260812 19:27:18.872037 8278 leader_election.cc:341] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.907922 8278 leader_election.cc:302] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:18.909319 9659 raft_consensus.cc:2726] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:18.917369 8636 tablet_bootstrap.cc:492] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:18.924341 8623 tablet_bootstrap.cc:492] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:18.924736 8623 ts_tablet_manager.cc:1397] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.188s user 0.006s sys 0.007s
I20260812 19:27:18.925684 8636 tablet_bootstrap.cc:654] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:18.927182 8623 raft_consensus.cc:348] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:18.927820 8623 raft_consensus.cc:374] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:27:18.942713 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.711s (SENT)
I20260812 19:27:18.943171 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:18.946779 8627 tablet_bootstrap.cc:492] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:18.952646 8627 tablet_bootstrap.cc:654] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:18.955437 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 46100.4us
W20260812 19:27:18.956077 8278 leader_election.cc:341] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:18.956454 8278 leader_election.cc:302] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:18.959977 9921 raft_consensus.cc:2726] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:18.928074 8623 raft_consensus.cc:729] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:18.974321 8623 consensus_queue.cc:260] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:18.982098 10015 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:27:18.990599 8636 tablet_bootstrap.cc:492] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:18.990742 9984 raft_consensus.cc:482] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:18.991084 8636 ts_tablet_manager.cc:1397] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.074s user 0.009s sys 0.003s
I20260812 19:27:18.991412 9984 raft_consensus.cc:504] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.006253 8443 leader_election.cc:302] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:19.006006 8636 raft_consensus.cc:348] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.006706 8636 raft_consensus.cc:374] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.006946 8636 raft_consensus.cc:729] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.007616 10013 raft_consensus.cc:2726] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:19.027590 8623 ts_tablet_manager.cc:1428] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.103s user 0.006s sys 0.001s
I20260812 19:27:19.007513 8636 consensus_queue.cc:260] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.036779 8623 tablet_bootstrap.cc:492] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:19.041908 8636 ts_tablet_manager.cc:1428] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.051s user 0.004s sys 0.004s
I20260812 19:27:19.056766 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:19.057597 8344 raft_consensus.cc:2454] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:19.061054 8636 tablet_bootstrap.cc:492] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:19.066987 8623 tablet_bootstrap.cc:654] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:19.074115 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:19.074753 8351 raft_consensus.cc:3037] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:19.076503 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b8e6cecfa04aa685014277c15fb6f4" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:19.077092 8356 raft_consensus.cc:3037] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:19.078190 9921 raft_consensus.cc:482] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.078600 9921 raft_consensus.cc:504] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.081576 9921 leader_election.cc:288] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:19.091063 8356 raft_consensus.cc:2454] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:19.096753 8627 tablet_bootstrap.cc:492] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:19.097694 8627 ts_tablet_manager.cc:1397] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.151s user 0.019s sys 0.002s
I20260812 19:27:19.100777 8351 raft_consensus.cc:2454] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:19.105209 8627 raft_consensus.cc:348] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:19.111006 8627 raft_consensus.cc:374] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.112246 8627 raft_consensus.cc:729] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.117812 8636 tablet_bootstrap.cc:654] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:19.119347 8627 consensus_queue.cc:260] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:19.137609 8627 ts_tablet_manager.cc:1428] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.039s user 0.005s sys 0.000s
I20260812 19:27:19.143215 8627 tablet_bootstrap.cc:492] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:19.143925 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b04529031f04302846b39d585d74ad5" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:19.144500 8507 raft_consensus.cc:3037] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:19.153275 8507 raft_consensus.cc:2454] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 2.
I20260812 19:27:19.083048 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "867e426fedce4c9895b7b9a13f8bb5e3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:19.132284 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067fdfc16a7e44c2b3dac5fe262a5728" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:19.163439 8281 leader_election.cc:341] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:19.134402 9984 leader_election.cc:288] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:19.172490 8636 tablet_bootstrap.cc:492] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:19.172966 8636 ts_tablet_manager.cc:1397] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.112s user 0.006s sys 0.005s
I20260812 19:27:19.177923 9984 raft_consensus.cc:482] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.178445 9984 raft_consensus.cc:504] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.186220 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "067fdfc16a7e44c2b3dac5fe262a5728" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:19.188146 8108 leader_election.cc:302] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:19.191720 9998 raft_consensus.cc:2781] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:19.192181 9998 raft_consensus.cc:482] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:19.192600 9998 raft_consensus.cc:3037] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:19.199061 8511 raft_consensus.cc:3037] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:19.210958 8636 raft_consensus.cc:348] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.211758 8636 raft_consensus.cc:374] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.211227 9998 raft_consensus.cc:504] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.212028 8636 raft_consensus.cc:729] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.218317 8636 consensus_queue.cc:260] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.229387 8636 ts_tablet_manager.cc:1428] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.056s user 0.004s sys 0.004s
I20260812 19:27:19.234417 8627 tablet_bootstrap.cc:654] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:19.242444 9984 leader_election.cc:288] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:19.251739 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "867e426fedce4c9895b7b9a13f8bb5e3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:19.270459 8636 tablet_bootstrap.cc:492] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:19.273679 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41e6528b71e4d35a6aee94bb7dd7a57" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:19.275367 8108 leader_election.cc:302] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:19.278697 8636 tablet_bootstrap.cc:654] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:19.280519 10003 raft_consensus.cc:2781] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:19.280995 10003 raft_consensus.cc:686] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:19.281512 8623 tablet_bootstrap.cc:492] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:19.281901 8623 ts_tablet_manager.cc:1397] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.245s user 0.008s sys 0.002s
I20260812 19:27:19.281740 10003 consensus_queue.cc:237] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.308516 8627 tablet_bootstrap.cc:492] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:19.308933 8627 ts_tablet_manager.cc:1397] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.166s user 0.002s sys 0.014s
I20260812 19:27:19.313890 9921 raft_consensus.cc:482] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.314375 9921 raft_consensus.cc:504] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.316162 9921 leader_election.cc:288] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:19.319712 8278 leader_election.cc:302] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:19.320629 9659 raft_consensus.cc:2781] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:19.321028 9659 raft_consensus.cc:686] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 2 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:19.321691 9659 consensus_queue.cc:237] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.330291 8636 tablet_bootstrap.cc:492] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:19.330741 8636 ts_tablet_manager.cc:1397] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.061s user 0.013s sys 0.000s
I20260812 19:27:19.336308 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94407c13a91c4a76bd3aa1c1c8032384" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:19.337244 8636 raft_consensus.cc:348] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.337879 8636 raft_consensus.cc:374] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.338117 8636 raft_consensus.cc:729] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.338685 8636 consensus_queue.cc:260] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:19.343511 8281 leader_election.cc:341] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:19.346292 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 88859.1us
W20260812 19:27:19.291540 10023 log.cc:924] Time spent T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.116s user 0.000s sys 0.001s
I20260812 19:27:19.356391 8636 ts_tablet_manager.cc:1428] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.025s user 0.008s sys 0.000s
I20260812 19:27:19.362829 8636 tablet_bootstrap.cc:492] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:19.371074 9998 leader_election.cc:288] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:19.390137 8627 raft_consensus.cc:348] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.390851 8627 raft_consensus.cc:374] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.391084 8627 raft_consensus.cc:729] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.391659 8627 consensus_queue.cc:260] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.397571 8636 tablet_bootstrap.cc:654] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:19.406559 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 61126.5us
I20260812 19:27:19.408337 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:19.411329 8107 leader_election.cc:341] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:19.415119 8623 raft_consensus.cc:348] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.415827 8623 raft_consensus.cc:374] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.416079 8623 raft_consensus.cc:729] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.416712 8623 consensus_queue.cc:260] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.438592 8636 tablet_bootstrap.cc:492] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:19.438992 8636 ts_tablet_manager.cc:1397] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.076s user 0.010s sys 0.000s
I20260812 19:27:19.441346 8636 raft_consensus.cc:348] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.442039 8636 raft_consensus.cc:374] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.442284 8636 raft_consensus.cc:729] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.443073 8623 ts_tablet_manager.cc:1428] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.161s user 0.006s sys 0.003s
I20260812 19:27:19.442843 8636 consensus_queue.cc:260] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.455765 9952 raft_consensus.cc:482] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.456979 8636 ts_tablet_manager.cc:1428] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260812 19:27:19.457103 8627 ts_tablet_manager.cc:1428] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.148s user 0.003s sys 0.004s
I20260812 19:27:19.456472 9952 raft_consensus.cc:504] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.418646 10037 tablet.cc:1722] T f7c9e6328b70417cbeecf31f318f9b61 P 93aafc5b36824666a82aa55bc73df9e7: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:19.462726 9952 leader_election.cc:288] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:19.465489 9984 raft_consensus.cc:482] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.466030 9984 raft_consensus.cc:504] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.468185 9984 leader_election.cc:288] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:19.469703 9984 raft_consensus.cc:482] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.476788 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:19.479295 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 202924us
I20260812 19:27:19.479972 8108 leader_election.cc:302] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:19.482282 9998 raft_consensus.cc:2781] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:19.482743 9998 raft_consensus.cc:686] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
W20260812 19:27:19.483523 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 68983.8us
I20260812 19:27:19.484166 8623 tablet_bootstrap.cc:492] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:19.483621 9998 consensus_queue.cc:237] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:19.497241 8281 leader_election.cc:341] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:19.501251 8627 tablet_bootstrap.cc:492] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:19.516940 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 197311us
I20260812 19:27:19.470175 9984 raft_consensus.cc:504] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.522806 9984 leader_election.cc:288] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:19.501806 10038 tablet.cc:1722] T f7c9e6328b70417cbeecf31f318f9b61 P 6a95b50ceede4dc99913aec28ddaa380: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:19.539912 8636 tablet_bootstrap.cc:492] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:19.545393 8636 tablet_bootstrap.cc:654] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:19.544574 8278 leader_election.cc:341] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:19.546528 8278 leader_election.cc:302] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:19.548640 9659 raft_consensus.cc:2726] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:19.552760 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:19.555382 9984 consensus_queue.cc:1035] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:19.566181 8636 tablet_bootstrap.cc:492] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:19.566665 8636 ts_tablet_manager.cc:1397] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.027s user 0.008s sys 0.000s
I20260812 19:27:19.569433 8636 raft_consensus.cc:348] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.570262 8636 raft_consensus.cc:374] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.570523 8636 raft_consensus.cc:729] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.571132 8636 consensus_queue.cc:260] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.571519 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:19.581050 9984 raft_consensus.cc:482] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.581578 9984 raft_consensus.cc:504] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.585503 9984 leader_election.cc:288] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:19.592937 8636 ts_tablet_manager.cc:1428] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.026s user 0.006s sys 0.001s
I20260812 19:27:19.594905 8627 tablet_bootstrap.cc:654] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:19.598417 8623 tablet_bootstrap.cc:654] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:19.608841 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:19.609812 8182 raft_consensus.cc:2379] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
W20260812 19:27:19.625844 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 75961.3us
I20260812 19:27:19.668321 9952 raft_consensus.cc:482] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.669201 9952 raft_consensus.cc:504] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:19.670975 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:19.672067 8349 raft_consensus.cc:3037] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:19.672917 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:19.674809 8281 leader_election.cc:341] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:19.672101 9952 leader_election.cc:288] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:19.707031 8636 tablet_bootstrap.cc:492] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:19.706895 8510 raft_consensus.cc:3037] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:19.734669 8636 tablet_bootstrap.cc:654] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:19.770265 8443 leader_election.cc:302] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:19.773108 9984 raft_consensus.cc:2726] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:19.791097 9998 raft_consensus.cc:482] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.792595 9998 raft_consensus.cc:504] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.798852 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:19.799494 8511 raft_consensus.cc:2454] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:19.800940 8107 leader_election.cc:302] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:19.802232 10007 raft_consensus.cc:2781] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:19.802875 10007 raft_consensus.cc:482] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:19.803360 10007 raft_consensus.cc:3037] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:19.820590 10003 raft_consensus.cc:482] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:19.821342 10003 raft_consensus.cc:504] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.825088 10003 leader_election.cc:288] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:19.827112 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:19.829144 8107 leader_election.cc:341] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:19.834277 8627 tablet_bootstrap.cc:492] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:19.834791 8627 ts_tablet_manager.cc:1397] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.334s user 0.007s sys 0.005s
I20260812 19:27:19.842525 8623 tablet_bootstrap.cc:492] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:19.842955 8623 ts_tablet_manager.cc:1397] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.360s user 0.013s sys 0.000s
I20260812 19:27:19.845801 8507 raft_consensus.cc:3037] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:19.847124 8623 raft_consensus.cc:348] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.847750 8623 raft_consensus.cc:374] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.847970 8623 raft_consensus.cc:729] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.850602 8623 consensus_queue.cc:260] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:19.863409 8627 raft_consensus.cc:348] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:19.864114 8627 raft_consensus.cc:374] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.864392 8627 raft_consensus.cc:729] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.866847 8627 consensus_queue.cc:260] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:19.870486 8627 ts_tablet_manager.cc:1428] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.035s user 0.005s sys 0.001s
I20260812 19:27:19.862562 9915 consensus_queue.cc:1035] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260812 19:27:19.879541 8636 tablet_bootstrap.cc:492] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:19.880062 8636 ts_tablet_manager.cc:1397] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.173s user 0.005s sys 0.016s
I20260812 19:27:19.871659 8627 tablet_bootstrap.cc:492] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:19.883122 8636 raft_consensus.cc:348] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.883931 8636 raft_consensus.cc:374] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:19.860757 9998 leader_election.cc:288] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:19.878353 8623 ts_tablet_manager.cc:1428] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.035s user 0.008s sys 0.000s
I20260812 19:27:19.901561 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94407c13a91c4a76bd3aa1c1c8032384" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:19.903057 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:19.904452 8349 raft_consensus.cc:2454] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:19.913290 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:19.925097 8623 tablet_bootstrap.cc:492] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:19.935343 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f41e6528b71e4d35a6aee94bb7dd7a57" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:19.884220 8636 raft_consensus.cc:729] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:19.952188 8636 consensus_queue.cc:260] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:19.954238 8636 ts_tablet_manager.cc:1428] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.074s user 0.005s sys 0.000s
I20260812 19:27:19.963367 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9293d85d08c34dbeb3f324322f2d656c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:19.964628 8352 raft_consensus.cc:2379] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:19.973606 10054 tablet.cc:1722] T f7c9e6328b70417cbeecf31f318f9b61 P 4f26a5f8e5934d8d8c026a2d957c78a5: Alter schema from (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
PRIMARY KEY (key)
) version 1
I20260812 19:27:19.982393 10053 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:19.983182 10053 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:19.993952 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9be4dabb7fa042bd8fa6b45fa63e8674" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:19.994325 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58149ab874b44f63b01ea611814e1417" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:19.995781 8349 raft_consensus.cc:2379] T 58149ab874b44f63b01ea611814e1417 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:20.000142 10007 raft_consensus.cc:504] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.005429 8352 raft_consensus.cc:2379] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:19.984965 8636 tablet_bootstrap.cc:492] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:19.998868 8443 leader_election.cc:302] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:20.015517 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.667s (SENT)
I20260812 19:27:20.015936 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:20.020790 8443 leader_election.cc:302] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:20.024427 9977 raft_consensus.cc:2726] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:20.025358 9977 consensus_queue.cc:1035] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:20.026868 10013 raft_consensus.cc:3037] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.004009 10007 leader_election.cc:288] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:20.032212 9952 raft_consensus.cc:482] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:20.033243 9952 raft_consensus.cc:504] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.038038 9952 leader_election.cc:288] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:20.043990 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:20.054646 10057 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 19:27:20.061477 8278 leader_election.cc:341] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:20.062570 8278 leader_election.cc:302] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:20.064670 10012 raft_consensus.cc:2726] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:20.065745 8278 leader_election.cc:341] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:20.067255 10013 raft_consensus.cc:2726] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:20.062312 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 46824.8us
I20260812 19:27:20.068930 8278 leader_election.cc:302] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:20.072661 10012 raft_consensus.cc:2726] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:20.078395 8278 leader_election.cc:341] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:20.079551 8278 leader_election.cc:302] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:20.089371 8627 tablet_bootstrap.cc:654] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:20.082463 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 57868.5us
I20260812 19:27:20.090564 10012 raft_consensus.cc:2726] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:20.048736 10053 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:20.101188 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:20.101886 8356 raft_consensus.cc:2454] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:20.102926 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:20.103639 8351 raft_consensus.cc:2454] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:20.103674 8443 leader_election.cc:302] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:20.104740 9977 raft_consensus.cc:3037] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.105283 8443 leader_election.cc:302] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:20.106235 10058 raft_consensus.cc:2726] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:20.109123 8514 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff5b2d23d734217b0b10e50834b8883" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:20.113515 9977 raft_consensus.cc:2726] T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:20.120983 8278 leader_election.cc:341] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:20.129905 8636 tablet_bootstrap.cc:654] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.140389 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:20.145347 8507 raft_consensus.cc:3037] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Advancing to term 2
W20260812 19:27:20.145466 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 166509us
I20260812 19:27:20.152070 8507 raft_consensus.cc:2454] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 2.
I20260812 19:27:20.157982 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff5b2d23d734217b0b10e50834b8883" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:20.161369 8107 leader_election.cc:302] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:20.166433 8636 tablet_bootstrap.cc:492] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:20.166908 8636 ts_tablet_manager.cc:1397] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.182s user 0.010s sys 0.001s
W20260812 19:27:20.168704 8281 leader_election.cc:341] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:20.169131 8281 leader_election.cc:302] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:20.171787 9659 raft_consensus.cc:2726] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:20.173780 10013 raft_consensus.cc:482] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:20.174290 10013 raft_consensus.cc:504] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.176869 10013 leader_election.cc:288] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:20.178632 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b8e6cecfa04aa685014277c15fb6f4" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:20.185894 8351 raft_consensus.cc:2379] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:20.190922 10013 raft_consensus.cc:482] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:20.191448 10013 raft_consensus.cc:504] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:20.194722 8636 raft_consensus.cc:348] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.195147 10013 leader_election.cc:288] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:20.195420 8636 raft_consensus.cc:374] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.195681 8636 raft_consensus.cc:729] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.195962 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:20.197110 8352 raft_consensus.cc:2454] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:20.203600 8443 leader_election.cc:302] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:20.210093 10013 raft_consensus.cc:2781] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:20.211139 10013 raft_consensus.cc:482] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:20.211581 10013 raft_consensus.cc:3037] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.219365 8636 consensus_queue.cc:260] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.233515 10013 raft_consensus.cc:504] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:20.221637 8627 tablet_bootstrap.cc:492] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:20.235818 8627 ts_tablet_manager.cc:1397] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.364s user 0.008s sys 0.019s
I20260812 19:27:20.237406 8636 ts_tablet_manager.cc:1428] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.070s user 0.008s sys 0.000s
I20260812 19:27:20.249555 9998 raft_consensus.cc:2781] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:20.250267 9998 raft_consensus.cc:686] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [term 2 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:20.267122 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:20.267777 8356 raft_consensus.cc:3037] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:20.272454 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 111574us
W20260812 19:27:20.295020 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 148291us
I20260812 19:27:20.296521 10013 leader_election.cc:288] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:20.302115 8636 tablet_bootstrap.cc:492] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:20.313746 8623 tablet_bootstrap.cc:654] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.325116 10033 consensus_queue.cc:1035] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:20.251437 9998 consensus_queue.cc:237] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.321375 8356 raft_consensus.cc:2454] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:20.337448 8507 raft_consensus.cc:3037] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.338071 8443 leader_election.cc:302] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:20.339056 10013 raft_consensus.cc:2781] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:20.339849 10013 raft_consensus.cc:686] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:20.340794 10013 consensus_queue.cc:237] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:20.353479 8627 raft_consensus.cc:348] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.368181 8627 raft_consensus.cc:374] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.369354 8627 raft_consensus.cc:729] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.370790 8627 consensus_queue.cc:260] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:20.397044 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 45489us
W20260812 19:27:20.406140 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 46641.3us
W20260812 19:27:20.407423 8281 consensus_peers.cc:487] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b04529031f04302846b39d585d74ad5. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:20.409520 8627 ts_tablet_manager.cc:1428] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.173s user 0.006s sys 0.000s
I20260812 19:27:20.410653 8627 tablet_bootstrap.cc:492] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:20.417032 10067 consensus_queue.cc:1035] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260812 19:27:20.419902 8627 tablet_bootstrap.cc:654] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.422646 8108 leader_election.cc:302] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:20.424919 10064 raft_consensus.cc:2781] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:20.433377 10064 raft_consensus.cc:686] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:20.434279 10064 consensus_queue.cc:237] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.454531 8108 leader_election.cc:302] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:20.456362 10068 raft_consensus.cc:2781] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:20.456773 10068 raft_consensus.cc:482] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:20.457157 10068 raft_consensus.cc:3037] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.461171 10003 raft_consensus.cc:482] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:20.461701 10003 raft_consensus.cc:504] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.463723 10003 leader_election.cc:288] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:20.464720 10069 consensus_queue.cc:1035] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:27:20.470044 8511 raft_consensus.cc:1261] T 2b04529031f04302846b39d585d74ad5 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Refusing update from remote peer 93aafc5b36824666a82aa55bc73df9e7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260812 19:27:20.473070 9659 consensus_queue.cc:1035] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260812 19:27:20.486207 8636 tablet_bootstrap.cc:654] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.477866 9977 raft_consensus.cc:482] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:20.486776 9977 raft_consensus.cc:504] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.489602 9977 leader_election.cc:288] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:20.491572 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:20.492107 8356 raft_consensus.cc:2454] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:20.494189 8443 leader_election.cc:302] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:20.495726 9984 raft_consensus.cc:2781] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:20.496061 9984 raft_consensus.cc:482] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:20.496410 9984 raft_consensus.cc:3037] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.503460 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "867e426fedce4c9895b7b9a13f8bb5e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:20.518927 9984 raft_consensus.cc:504] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.525856 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b07f7215876740519164e7d7e08302bd" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:20.526448 8356 raft_consensus.cc:3037] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:20.536564 8356 raft_consensus.cc:2454] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 2.
I20260812 19:27:20.472548 8623 tablet_bootstrap.cc:492] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
W20260812 19:27:20.521744 8107 leader_election.cc:341] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:20.549559 8623 ts_tablet_manager.cc:1397] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.625s user 0.017s sys 0.014s
I20260812 19:27:20.556741 8636 tablet_bootstrap.cc:492] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:20.557232 8636 ts_tablet_manager.cc:1397] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.256s user 0.007s sys 0.005s
I20260812 19:27:20.566237 8627 tablet_bootstrap.cc:492] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:20.566660 8627 ts_tablet_manager.cc:1397] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.156s user 0.008s sys 0.006s
I20260812 19:27:20.568915 9984 leader_election.cc:288] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:20.569207 8627 raft_consensus.cc:348] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.570022 8627 raft_consensus.cc:374] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.570281 8627 raft_consensus.cc:729] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.570849 8627 consensus_queue.cc:260] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.575479 8623 raft_consensus.cc:348] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.576311 8623 raft_consensus.cc:374] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.578835 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:20.579394 8356 raft_consensus.cc:3037] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.559672 8636 raft_consensus.cc:348] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.591634 8636 raft_consensus.cc:374] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.591967 8636 raft_consensus.cc:729] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.592778 8636 consensus_queue.cc:260] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.595722 9984 raft_consensus.cc:482] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:20.576794 8623 raft_consensus.cc:729] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.596215 9984 raft_consensus.cc:504] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.609141 9984 leader_election.cc:288] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:20.613523 8443 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:20.624409 8636 ts_tablet_manager.cc:1428] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.067s user 0.007s sys 0.000s
I20260812 19:27:20.630208 8636 tablet_bootstrap.cc:492] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:20.613529 8623 consensus_queue.cc:260] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.632287 8623 ts_tablet_manager.cc:1428] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.059s user 0.005s sys 0.000s
I20260812 19:27:20.633371 8623 tablet_bootstrap.cc:492] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:20.633700 8627 ts_tablet_manager.cc:1428] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.067s user 0.007s sys 0.000s
I20260812 19:27:20.634966 8627 tablet_bootstrap.cc:492] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:20.641736 10068 raft_consensus.cc:504] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:20.643777 10068 leader_election.cc:288] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:20.643999 8636 tablet_bootstrap.cc:654] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.651592 9984 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:20.652115 9984 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.654443 9984 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:20.666481 9984 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:20.666975 9984 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:20.669030 8443 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:20.670385 9984 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:20.673517 8443 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:20.700970 8627 tablet_bootstrap.cc:654] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.662387 8356 raft_consensus.cc:2454] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:20.710493 8443 leader_election.cc:302] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:20.711510 10013 raft_consensus.cc:2781] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:20.713905 10013 raft_consensus.cc:686] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:20.714953 10013 consensus_queue.cc:237] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.716585 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "867e426fedce4c9895b7b9a13f8bb5e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:20.717152 8356 raft_consensus.cc:2454] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:27:20.674106 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 63249us
I20260812 19:27:20.708299 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "05b8e6cecfa04aa685014277c15fb6f4" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:20.709613 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:20.724766 8176 raft_consensus.cc:2379] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:20.710855 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:20.712376 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:20.725659 8180 raft_consensus.cc:2379] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 6a95b50ceede4dc99913aec28ddaa380 in this term.
I20260812 19:27:20.729346 8636 tablet_bootstrap.cc:492] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:20.729777 8636 ts_tablet_manager.cc:1397] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.100s user 0.009s sys 0.000s
I20260812 19:27:20.730746 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:20.732116 8636 raft_consensus.cc:348] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.732901 8636 raft_consensus.cc:374] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.733135 8636 raft_consensus.cc:729] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.733868 8636 consensus_queue.cc:260] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.735386 8636 ts_tablet_manager.cc:1428] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.005s user 0.003s sys 0.002s
I20260812 19:27:20.756834 9998 raft_consensus.cc:482] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:20.757469 9998 raft_consensus.cc:504] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.759392 9998 leader_election.cc:288] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:20.775091 10064 consensus_queue.cc:1035] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:20.790021 8636 tablet_bootstrap.cc:492] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:20.795678 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:20.806066 9659 raft_consensus.cc:482] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:20.806475 9659 raft_consensus.cc:504] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.819051 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f3c6d8f74d044948a893d756be9a838" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:20.820196 8510 raft_consensus.cc:2454] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:20.832698 9659 leader_election.cc:288] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:20.835279 8636 tablet_bootstrap.cc:654] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.835438 8107 leader_election.cc:302] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:20.838478 10063 raft_consensus.cc:2781] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:20.838884 10063 raft_consensus.cc:482] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:20.839237 10063 raft_consensus.cc:3037] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.848435 8623 tablet_bootstrap.cc:654] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.862396 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e40943867249c58fee943fc8ed3fb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:20.866171 8636 tablet_bootstrap.cc:492] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:20.866577 8636 ts_tablet_manager.cc:1397] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.083s user 0.005s sys 0.004s
I20260812 19:27:20.867260 8627 tablet_bootstrap.cc:492] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:20.867671 8627 ts_tablet_manager.cc:1397] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.233s user 0.011s sys 0.007s
W20260812 19:27:20.869642 8281 leader_election.cc:341] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:20.870184 8627 raft_consensus.cc:348] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.870853 8627 raft_consensus.cc:374] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.871071 8627 raft_consensus.cc:729] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.871585 8627 consensus_queue.cc:260] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:20.876931 8636 raft_consensus.cc:348] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.877635 8636 raft_consensus.cc:374] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:20.877902 8636 raft_consensus.cc:729] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:20.878449 8636 consensus_queue.cc:260] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.898228 8446 leader_election.cc:302] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:20.898784 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 76817.1us
I20260812 19:27:20.899375 10058 raft_consensus.cc:2726] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:20.901572 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e40943867249c58fee943fc8ed3fb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:20.902196 8507 raft_consensus.cc:2454] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
W20260812 19:27:20.905929 8446 leader_election.cc:341] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:20.909507 8446 leader_election.cc:341] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:20.912379 8446 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:20.912796 8446 leader_election.cc:302] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:20.913381 8636 ts_tablet_manager.cc:1428] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.047s user 0.007s sys 0.000s
I20260812 19:27:20.913491 10058 raft_consensus.cc:2726] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:20.920928 8636 tablet_bootstrap.cc:492] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:20.927915 8627 ts_tablet_manager.cc:1428] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.060s user 0.005s sys 0.000s
I20260812 19:27:20.929060 8627 tablet_bootstrap.cc:492] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:20.934320 8446 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:20.934957 8446 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:20.935783 10058 raft_consensus.cc:2726] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:20.941670 8636 tablet_bootstrap.cc:654] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:20.952657 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bc8ae6adf7b64a468112753c2831ac87" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:20.953778 8352 raft_consensus.cc:2379] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
W20260812 19:27:20.960981 7945 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet df369d3c4e004c29ac65c5ecf7f8c4cc (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet df369d3c4e004c29ac65c5ecf7f8c4cc consensus state has no leader
I20260812 19:27:20.965423 8623 tablet_bootstrap.cc:492] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:20.966656 8623 ts_tablet_manager.cc:1397] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.333s user 0.008s sys 0.003s
I20260812 19:27:20.985416 8108 leader_election.cc:302] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:20.986802 9998 raft_consensus.cc:2781] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:20.987211 9998 raft_consensus.cc:482] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:20.987604 9998 raft_consensus.cc:3037] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:20.990480 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f3c6d8f74d044948a893d756be9a838" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:20.991335 8352 raft_consensus.cc:2454] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:21.005242 8623 raft_consensus.cc:348] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.005980 8623 raft_consensus.cc:374] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:21.006237 8623 raft_consensus.cc:729] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.006894 8623 consensus_queue.cc:260] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:20.954552 10063 raft_consensus.cc:504] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.022094 8636 tablet_bootstrap.cc:492] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:21.022562 8636 ts_tablet_manager.cc:1397] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.102s user 0.008s sys 0.002s
I20260812 19:27:21.023563 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f3c6d8f74d044948a893d756be9a838" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:21.024187 8515 raft_consensus.cc:3037] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.026964 8636 raft_consensus.cc:348] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.027726 8636 raft_consensus.cc:374] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:27:21.032621 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 47272.3us
I20260812 19:27:21.035704 10103 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:21.036650 10103 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:21.040720 8278 leader_election.cc:302] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:21.041568 10090 raft_consensus.cc:2781] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:21.042065 10090 raft_consensus.cc:482] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:21.042681 10090 raft_consensus.cc:3037] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.053344 10063 leader_election.cc:288] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:21.080127 8627 tablet_bootstrap.cc:654] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:21.028019 8636 raft_consensus.cc:729] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.084571 8636 consensus_queue.cc:260] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.087159 8636 ts_tablet_manager.cc:1428] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.064s user 0.005s sys 0.000s
I20260812 19:27:21.091991 8623 ts_tablet_manager.cc:1428] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.125s user 0.004s sys 0.001s
W20260812 19:27:21.094120 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 60727.8us
I20260812 19:27:21.096519 10033 consensus_queue.cc:1035] T 05b8e6cecfa04aa685014277c15fb6f4 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:21.097832 10033 consensus_queue.cc:1035] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:21.102861 10090 raft_consensus.cc:504] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.104907 10033 consensus_queue.cc:1035] T 9293d85d08c34dbeb3f324322f2d656c P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:21.112082 8108 leader_election.cc:302] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:21.114137 8636 tablet_bootstrap.cc:492] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:21.117619 10058 raft_consensus.cc:482] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.118225 10058 raft_consensus.cc:504] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.122049 10058 leader_election.cc:288] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:21.127626 8623 tablet_bootstrap.cc:492] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:21.123739 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:21.132982 8352 raft_consensus.cc:2454] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:21.133247 10003 raft_consensus.cc:2726] T bc8ae6adf7b64a468112753c2831ac87 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:21.140741 8443 leader_election.cc:302] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:27:21.141410 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.528s (SENT)
I20260812 19:27:21.141661 10058 raft_consensus.cc:2781] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:21.141860 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:21.142132 10058 raft_consensus.cc:482] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:21.142746 10058 raft_consensus.cc:3037] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.158447 10090 leader_election.cc:288] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:21.158921 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e40943867249c58fee943fc8ed3fb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:21.159739 8507 raft_consensus.cc:3037] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.159862 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "14e40943867249c58fee943fc8ed3fb0" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:21.161401 8281 leader_election.cc:341] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:21.168586 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 56584.4us
I20260812 19:27:21.176744 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:21.178614 8627 tablet_bootstrap.cc:492] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:21.179078 8627 ts_tablet_manager.cc:1397] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.250s user 0.014s sys 0.000s
I20260812 19:27:21.180979 10103 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:21.181630 8507 raft_consensus.cc:2454] T 14e40943867249c58fee943fc8ed3fb0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:21.183245 8627 raft_consensus.cc:348] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.184000 8627 raft_consensus.cc:374] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:21.185322 8278 leader_election.cc:302] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:21.186162 9952 raft_consensus.cc:2781] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:21.186571 9952 raft_consensus.cc:686] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:21.187470 9952 consensus_queue.cc:237] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.188614 10107 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:27:21.198920 8627 raft_consensus.cc:729] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.203728 8636 tablet_bootstrap.cc:654] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:21.207882 8515 raft_consensus.cc:2454] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:21.209889 8107 leader_election.cc:302] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:21.203217 8627 consensus_queue.cc:260] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.211009 10063 raft_consensus.cc:2781] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:21.211656 10063 raft_consensus.cc:686] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:21.212523 10063 consensus_queue.cc:237] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.214846 8627 ts_tablet_manager.cc:1428] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.035s user 0.006s sys 0.005s
I20260812 19:27:21.215698 8627 tablet_bootstrap.cc:492] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:21.215842 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 46351.1us
I20260812 19:27:21.250891 8627 tablet_bootstrap.cc:654] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:21.258213 8446 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:21.258649 8446 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:21.259882 9984 raft_consensus.cc:2726] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:21.267123 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f3c6d8f74d044948a893d756be9a838" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:21.267623 9952 raft_consensus.cc:482] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.267724 8352 raft_consensus.cc:3037] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.268119 9952 raft_consensus.cc:504] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.270983 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c9d071f07e5410d9e660986ab6858ef" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:21.271437 9952 leader_election.cc:288] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:21.271623 8507 raft_consensus.cc:2454] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:21.276522 10058 raft_consensus.cc:504] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.278548 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c9d071f07e5410d9e660986ab6858ef" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:21.281224 8281 leader_election.cc:341] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.283039 8278 leader_election.cc:302] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:21.284320 9659 raft_consensus.cc:2781] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:21.284657 9659 raft_consensus.cc:482] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:21.285010 9659 raft_consensus.cc:3037] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.292310 9659 raft_consensus.cc:504] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.294548 9659 leader_election.cc:288] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:21.295086 8352 raft_consensus.cc:2454] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:21.295657 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c9d071f07e5410d9e660986ab6858ef" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:21.295095 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c9d071f07e5410d9e660986ab6858ef" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:21.297281 8515 raft_consensus.cc:3037] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.288983 9998 raft_consensus.cc:504] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:21.297909 8281 leader_election.cc:341] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.301129 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "867e426fedce4c9895b7b9a13f8bb5e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
W20260812 19:27:21.305518 8107 leader_election.cc:341] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.302523 8636 tablet_bootstrap.cc:492] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:21.313225 8636 ts_tablet_manager.cc:1397] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.199s user 0.009s sys 0.010s
I20260812 19:27:21.317857 8636 raft_consensus.cc:348] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.318589 8636 raft_consensus.cc:374] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:21.318919 8636 raft_consensus.cc:729] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.338963 10033 consensus_queue.cc:1035] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:21.319598 8636 consensus_queue.cc:260] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.347776 8636 ts_tablet_manager.cc:1428] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260812 19:27:21.348711 8636 tablet_bootstrap.cc:492] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:21.354260 8510 raft_consensus.cc:1261] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Refusing update from remote peer 6a95b50ceede4dc99913aec28ddaa380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:27:21.355898 10033 consensus_queue.cc:1035] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:27:21.377440 9929 raft_consensus.cc:482] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.377965 9929 raft_consensus.cc:504] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.378438 8636 tablet_bootstrap.cc:654] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:21.379940 9929 leader_election.cc:288] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:21.388022 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:21.403246 10013 consensus_queue.cc:1035] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:21.412870 9998 leader_election.cc:288] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:21.304189 8623 tablet_bootstrap.cc:654] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:21.418215 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:21.424903 8446 leader_election.cc:341] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.427029 9984 consensus_queue.cc:1035] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:21.444389 10114 log.cc:924] Time spent T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.053s user 0.000s sys 0.001s
I20260812 19:27:21.447782 10058 leader_election.cc:288] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:21.448980 10113 log.cc:924] Time spent T 58149ab874b44f63b01ea611814e1417 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.097s user 0.000s sys 0.000s
I20260812 19:27:21.454768 8627 tablet_bootstrap.cc:492] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:21.455308 8627 ts_tablet_manager.cc:1397] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.240s user 0.017s sys 0.002s
W20260812 19:27:21.456627 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 44975.8us
I20260812 19:27:21.476033 9659 raft_consensus.cc:482] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.476099 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:21.477046 8349 raft_consensus.cc:3037] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.476704 9659 raft_consensus.cc:504] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.488718 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9f0afa2f3cee483facfbb2712917b829" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:21.489567 8353 raft_consensus.cc:2379] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:21.490499 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "867e426fedce4c9895b7b9a13f8bb5e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:21.491044 8350 raft_consensus.cc:3037] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.493903 8623 tablet_bootstrap.cc:492] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:21.494323 8623 ts_tablet_manager.cc:1397] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.367s user 0.009s sys 0.000s
I20260812 19:27:21.497664 8349 raft_consensus.cc:2454] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:21.499979 8350 raft_consensus.cc:2454] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:21.507620 8515 raft_consensus.cc:2454] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
W20260812 19:27:21.518501 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 93356.9us
I20260812 19:27:21.525146 9929 raft_consensus.cc:482] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.532228 9929 raft_consensus.cc:504] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.532634 9659 leader_election.cc:288] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:21.534741 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da136cadb824d18886132c8f26ccb22" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:21.535872 9929 leader_election.cc:288] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:21.539283 8281 leader_election.cc:341] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.549389 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:21.550854 8182 raft_consensus.cc:3037] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:21.570226 8446 leader_election.cc:341] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.613293 10063 consensus_queue.cc:1035] T 58149ab874b44f63b01ea611814e1417 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:21.633330 8623 raft_consensus.cc:348] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.634084 8623 raft_consensus.cc:374] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:21.634353 8623 raft_consensus.cc:729] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.634995 8623 consensus_queue.cc:260] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.580037 8627 raft_consensus.cc:348] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.653585 8627 raft_consensus.cc:374] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:21.653945 8627 raft_consensus.cc:729] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.654788 8627 consensus_queue.cc:260] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:21.656546 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 85282.6us
I20260812 19:27:21.662891 9952 raft_consensus.cc:482] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.663924 9952 raft_consensus.cc:504] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.668833 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:21.669754 8278 leader_election.cc:302] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:21.670832 10097 raft_consensus.cc:2781] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:21.671535 10097 raft_consensus.cc:686] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:21.671829 8443 leader_election.cc:302] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:21.672915 8108 leader_election.cc:302] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:21.673017 10097 consensus_queue.cc:237] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.674707 10033 raft_consensus.cc:2726] T 9f0afa2f3cee483facfbb2712917b829 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:21.676720 8108 leader_election.cc:302] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:21.677448 10033 raft_consensus.cc:2781] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:21.678086 10033 raft_consensus.cc:686] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:21.678344 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:21.679325 8353 raft_consensus.cc:2454] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:21.679141 10033 consensus_queue.cc:237] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:21.670466 8281 leader_election.cc:341] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.701316 10130 raft_consensus.cc:482] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.702096 10130 raft_consensus.cc:504] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.719635 8627 ts_tablet_manager.cc:1428] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.264s user 0.014s sys 0.000s
I20260812 19:27:21.731010 9952 leader_election.cc:288] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:21.710492 8636 tablet_bootstrap.cc:492] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:21.718756 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:21.744078 8636 ts_tablet_manager.cc:1397] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.396s user 0.009s sys 0.017s
W20260812 19:27:21.729038 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 57293.5us
I20260812 19:27:21.738905 10058 raft_consensus.cc:2781] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:21.752835 8623 ts_tablet_manager.cc:1428] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.258s user 0.008s sys 0.000s
I20260812 19:27:21.744388 8509 raft_consensus.cc:2454] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:21.755101 10058 raft_consensus.cc:686] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:21.756033 8636 raft_consensus.cc:348] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.756752 8636 raft_consensus.cc:374] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:21.756989 8636 raft_consensus.cc:729] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.756868 8107 leader_election.cc:302] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:21.757555 8636 consensus_queue.cc:260] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.758337 10068 raft_consensus.cc:2781] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:21.758901 10068 raft_consensus.cc:482] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:21.759258 8636 ts_tablet_manager.cc:1428] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.015s user 0.003s sys 0.000s
I20260812 19:27:21.759500 10068 raft_consensus.cc:3037] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.763567 10058 consensus_queue.cc:237] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.766383 9952 raft_consensus.cc:482] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:21.769026 10130 leader_election.cc:288] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:21.774302 8351 raft_consensus.cc:1261] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 [term 2 FOLLOWER]: Refusing update from remote peer 6a95b50ceede4dc99913aec28ddaa380: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260812 19:27:21.785812 7781 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.604s (SENT) [suppressed 2 similar messages]
I20260812 19:27:21.789729 8627 tablet_bootstrap.cc:492] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:21.813009 9952 raft_consensus.cc:504] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:21.818073 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ca59e00b52437a8d7ef06ebc194af3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:21.820820 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:21.821605 8351 raft_consensus.cc:2454] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
W20260812 19:27:21.837466 8281 leader_election.cc:341] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:21.824034 10140 consensus_queue.cc:1035] T b07f7215876740519164e7d7e08302bd P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260812 19:27:21.846081 8623 tablet_bootstrap.cc:492] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:21.848579 10068 raft_consensus.cc:504] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.855612 8623 tablet_bootstrap.cc:654] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:21.874761 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:21.875428 8515 raft_consensus.cc:3037] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.880596 10068 leader_election.cc:288] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:21.884814 8443 leader_election.cc:302] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:27:21.887727 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 64685.4us
I20260812 19:27:21.896319 8636 tablet_bootstrap.cc:492] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:21.912900 9952 leader_election.cc:288] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:21.931279 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:21.932199 8350 raft_consensus.cc:3037] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:21.933980 8623 tablet_bootstrap.cc:492] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:21.934376 8623 ts_tablet_manager.cc:1397] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.011s
I20260812 19:27:21.949957 8623 raft_consensus.cc:348] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.950819 8623 raft_consensus.cc:374] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:21.951121 8623 raft_consensus.cc:729] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:21.951809 8623 consensus_queue.cc:260] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:21.954506 8623 ts_tablet_manager.cc:1428] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.020s user 0.008s sys 0.000s
I20260812 19:27:22.009208 10148 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:22.010406 10148 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:22.011174 8350 raft_consensus.cc:2454] T e6ef4b3497284a799d4a4f45d7609e45 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:22.013046 8108 leader_election.cc:302] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:22.014382 9998 raft_consensus.cc:2781] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:21.886045 10130 consensus_queue.cc:1035] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260812 19:27:22.016979 9998 raft_consensus.cc:686] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:22.018322 9998 consensus_queue.cc:237] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.022644 8180 raft_consensus.cc:3037] T 14e40943867249c58fee943fc8ed3fb0 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:22.031010 8515 raft_consensus.cc:2454] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:22.045850 8627 tablet_bootstrap.cc:654] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.059302 8636 tablet_bootstrap.cc:654] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.041338 9984 raft_consensus.cc:2741] T e6ef4b3497284a799d4a4f45d7609e45 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 19:27:22.065339 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da136cadb824d18886132c8f26ccb22" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:22.069464 10127 consensus_queue.cc:1035] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:22.078891 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:22.083772 10068 consensus_queue.cc:1035] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:22.108153 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:22.108774 7802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in term 3.
I20260812 19:27:22.110059 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, fa34b607af684984bbfb5cd60a2f058d; no voters:
I20260812 19:27:22.124964 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ca59e00b52437a8d7ef06ebc194af3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:22.150774 8623 tablet_bootstrap.cc:492] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:22.161546 10148 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:22.168627 10158 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:27:22.169144 10158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Starting leader election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:22.169764 10158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:27:22.170362 10003 consensus_queue.cc:1035] T 5f3c6d8f74d044948a893d756be9a838 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:22.186633 8627 tablet_bootstrap.cc:492] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:22.187057 8627 ts_tablet_manager.cc:1397] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.398s user 0.011s sys 0.003s
I20260812 19:27:22.188097 10058 consensus_queue.cc:1035] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:27:22.189428 8278 leader_election.cc:341] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:22.189816 8278 leader_election.cc:302] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:22.190490 10097 raft_consensus.cc:2726] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:22.200548 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:22.205817 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 90042.3us
I20260812 19:27:22.207803 10097 raft_consensus.cc:482] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:22.208400 10097 raft_consensus.cc:504] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.211086 10097 leader_election.cc:288] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:22.213318 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:22.214830 8281 leader_election.cc:341] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:22.219630 9998 raft_consensus.cc:482] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:22.220405 9998 raft_consensus.cc:504] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.224668 9998 leader_election.cc:288] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:22.237356 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73ea5acf663420cbe9236c014d71199" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:22.241806 8636 tablet_bootstrap.cc:492] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:22.242244 8636 ts_tablet_manager.cc:1397] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.346s user 0.002s sys 0.012s
I20260812 19:27:22.245880 8636 raft_consensus.cc:348] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.246572 8636 raft_consensus.cc:374] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.246841 8636 raft_consensus.cc:729] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.247426 8636 consensus_queue.cc:260] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.253363 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73ea5acf663420cbe9236c014d71199" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:22.254056 8351 raft_consensus.cc:2454] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
W20260812 19:27:22.239411 8107 leader_election.cc:341] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:22.265311 8627 raft_consensus.cc:348] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.266268 8627 raft_consensus.cc:374] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.266597 8627 raft_consensus.cc:729] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.266526 8108 leader_election.cc:302] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5
I20260812 19:27:22.267463 8627 consensus_queue.cc:260] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.269323 8627 ts_tablet_manager.cc:1428] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.082s user 0.002s sys 0.005s
I20260812 19:27:22.270363 8627 tablet_bootstrap.cc:492] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:22.277925 10063 raft_consensus.cc:2781] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:22.278348 10063 raft_consensus.cc:482] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:22.278716 10063 raft_consensus.cc:3037] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:22.293164 10063 raft_consensus.cc:504] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:22.295979 10151 log.cc:924] Time spent T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380: Append to log took a long time: real 0.112s user 0.000s sys 0.000s
W20260812 19:27:22.341421 8278 leader_election.cc:341] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:22.342089 8278 leader_election.cc:302] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:22.343020 10127 raft_consensus.cc:2726] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:22.345695 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73ea5acf663420cbe9236c014d71199" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:22.346390 8510 raft_consensus.cc:3037] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:22.323402 10158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:22.355190 9424 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 4 FOLLOWER]: Rejecting Update request from peer b99a815f68ee4d93b167a67778a3e1a6 for earlier term 3. Current term is 4. Ops: []
I20260812 19:27:22.355832 8510 raft_consensus.cc:2454] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:22.357120 8107 leader_election.cc:302] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:22.360158 8636 ts_tablet_manager.cc:1428] T b73ea5acf663420cbe9236c014d71199 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.118s user 0.008s sys 0.000s
I20260812 19:27:22.361251 8636 tablet_bootstrap.cc:492] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:22.364601 10058 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:22.365507 10058 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:22.370097 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d"
I20260812 19:27:22.373883 10158 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 election: Requested vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:22.374277 10156 consensus_queue.cc:1046] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 }, Status: INVALID_TERM, Last received: 3.320, Next index: 321, Last known committed idx: 320, Time since last communication: 0.002s
I20260812 19:27:22.377516 10159 raft_consensus.cc:3032] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:27:22.378310 10159 raft_consensus.cc:729] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b99a815f68ee4d93b167a67778a3e1a6, State: Running, Role: LEADER
I20260812 19:27:22.379791 10159 consensus_queue.cc:260] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 320, Committed index: 320, Last appended: 3.320, Last appended by leader: 320, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:22.390513 10063 leader_election.cc:288] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:22.391995 10058 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:22.392725 10140 raft_consensus.cc:2781] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:22.393366 10140 raft_consensus.cc:686] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:22.394317 10159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:27:22.394547 10140 consensus_queue.cc:237] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:22.406510 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.604s (SENT)
I20260812 19:27:22.406952 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:22.422173 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:22.425803 10166 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260812 19:27:22.353520 8627 tablet_bootstrap.cc:654] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:22.400581 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 59201.4us
W20260812 19:27:22.508664 8278 leader_election.cc:341] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:22.514222 8636 tablet_bootstrap.cc:654] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.509033 8278 leader_election.cc:302] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:22.525606 10127 raft_consensus.cc:2726] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:22.530776 8446 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:22.538062 8627 tablet_bootstrap.cc:492] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:22.538484 8627 ts_tablet_manager.cc:1397] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.268s user 0.013s sys 0.005s
I20260812 19:27:22.541304 8627 raft_consensus.cc:348] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.541939 8627 raft_consensus.cc:374] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.542172 8627 raft_consensus.cc:729] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.542753 8627 consensus_queue.cc:260] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.565119 10090 consensus_queue.cc:1035] T 14e40943867249c58fee943fc8ed3fb0 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:22.565160 8627 ts_tablet_manager.cc:1428] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.026s user 0.007s sys 0.000s
I20260812 19:27:22.572036 8627 tablet_bootstrap.cc:492] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:22.590984 8278 leader_election.cc:341] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:22.591565 8278 leader_election.cc:302] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:22.592374 9952 raft_consensus.cc:2726] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:22.603760 8627 tablet_bootstrap.cc:654] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.636045 10138 raft_consensus.cc:482] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:22.636581 10138 raft_consensus.cc:504] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:22.637666 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 46716.4us
I20260812 19:27:22.640302 10138 leader_election.cc:288] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:22.650564 8627 tablet_bootstrap.cc:492] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:22.651068 8627 ts_tablet_manager.cc:1397] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.079s user 0.009s sys 0.000s
I20260812 19:27:22.654685 8627 raft_consensus.cc:348] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.655508 8627 raft_consensus.cc:374] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.655783 8627 raft_consensus.cc:729] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.661325 8636 tablet_bootstrap.cc:492] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:22.661824 8636 ts_tablet_manager.cc:1397] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.301s user 0.011s sys 0.000s
I20260812 19:27:22.666605 8636 raft_consensus.cc:348] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:22.667407 8636 raft_consensus.cc:374] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.667699 8636 raft_consensus.cc:729] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.668473 8636 consensus_queue.cc:260] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:22.680491 8627 consensus_queue.cc:260] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.681027 8636 ts_tablet_manager.cc:1428] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20260812 19:27:22.682184 8636 tablet_bootstrap.cc:492] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:22.684995 8446 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 544d3d74baa6477da11abbee139ee66f
W20260812 19:27:22.693301 8281 consensus_peers.cc:487] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:22.694227 8627 ts_tablet_manager.cc:1428] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.043s user 0.006s sys 0.003s
I20260812 19:27:22.695815 8636 tablet_bootstrap.cc:654] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.697722 8627 tablet_bootstrap.cc:492] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:22.707538 8636 tablet_bootstrap.cc:492] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:22.708074 8636 ts_tablet_manager.cc:1397] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.001s
I20260812 19:27:22.723533 8627 tablet_bootstrap.cc:654] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.725813 8636 raft_consensus.cc:348] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:22.740398 8636 raft_consensus.cc:374] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.743275 8636 raft_consensus.cc:729] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.744027 8636 consensus_queue.cc:260] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:22.746107 8636 ts_tablet_manager.cc:1428] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.038s user 0.003s sys 0.003s
I20260812 19:27:22.746989 8636 tablet_bootstrap.cc:492] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:22.755594 10097 raft_consensus.cc:482] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:22.756028 10097 raft_consensus.cc:504] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.757877 10097 leader_election.cc:288] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:22.759503 8636 tablet_bootstrap.cc:654] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.761271 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "613763d1b3074766bee2d026de516065" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:22.763322 8281 leader_election.cc:341] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:22.770910 10159 raft_consensus.cc:482] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:22.771396 10159 raft_consensus.cc:504] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:22.773833 10159 leader_election.cc:288] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563)
I20260812 19:27:22.775254 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:22.775811 7802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 3.
I20260812 19:27:22.779554 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:22.780292 9424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 4.
I20260812 19:27:22.782037 7948 leader_election.cc:302] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d; no voters:
I20260812 19:27:22.793082 8627 tablet_bootstrap.cc:492] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:22.793497 8627 ts_tablet_manager.cc:1397] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.096s user 0.007s sys 0.006s
I20260812 19:27:22.795694 8627 raft_consensus.cc:348] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.796375 8627 raft_consensus.cc:374] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.796634 8627 raft_consensus.cc:729] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.797168 8627 consensus_queue.cc:260] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.797809 8507 raft_consensus.cc:3037] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:22.798606 8627 ts_tablet_manager.cc:1428] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20260812 19:27:22.803617 8623 tablet_bootstrap.cc:654] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:22.806089 10159 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:27:22.806543 10159 raft_consensus.cc:482] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:22.806943 10159 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:27:22.818187 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b73ea5acf663420cbe9236c014d71199" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:22.818791 8350 raft_consensus.cc:3037] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:22.836026 9998 consensus_queue.cc:1035] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:22.836493 9360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.692s (SENT) [suppressed 2 similar messages]
I20260812 19:27:22.839167 8350 raft_consensus.cc:2454] T b73ea5acf663420cbe9236c014d71199 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:22.860982 8623 tablet_bootstrap.cc:492] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:22.861387 8623 ts_tablet_manager.cc:1397] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.711s user 0.013s sys 0.001s
I20260812 19:27:22.832041 10159 raft_consensus.cc:504] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:22.877930 8627 tablet_bootstrap.cc:492] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:22.896762 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d"
I20260812 19:27:22.897321 7802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 3 FOLLOWER]: Advancing to term 5
I20260812 19:27:22.905468 7802 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 5.
I20260812 19:27:22.906975 7948 leader_election.cc:302] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d; no voters:
I20260812 19:27:22.863972 8623 raft_consensus.cc:348] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.915995 8623 raft_consensus.cc:374] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.917130 8623 raft_consensus.cc:729] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.918706 8623 consensus_queue.cc:260] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:22.932057 10178 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:27:22.938552 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b99a815f68ee4d93b167a67778a3e1a6" candidate_term: 5 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
I20260812 19:27:22.939121 9424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:27:22.926409 8623 ts_tablet_manager.cc:1428] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.065s user 0.005s sys 0.001s
I20260812 19:27:22.936790 10159 leader_election.cc:288] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [CANDIDATE]: Term 5 election: Requested vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563)
I20260812 19:27:22.945277 10178 raft_consensus.cc:686] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 5 LEADER]: Becoming Leader. State: Replica: b99a815f68ee4d93b167a67778a3e1a6, State: Running, Role: LEADER
I20260812 19:27:22.946201 10178 consensus_queue.cc:237] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 320, Committed index: 320, Last appended: 3.320, Last appended by leader: 320, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:22.967218 10159 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 5 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:22.968384 10159 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
I20260812 19:27:22.971901 8636 tablet_bootstrap.cc:492] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:22.972313 8636 ts_tablet_manager.cc:1397] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.225s user 0.011s sys 0.005s
I20260812 19:27:22.974414 8636 raft_consensus.cc:348] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:22.975063 8636 raft_consensus.cc:374] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:22.975304 8636 raft_consensus.cc:729] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:22.977651 9424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b99a815f68ee4d93b167a67778a3e1a6 in term 5.
I20260812 19:27:22.994289 8623 tablet_bootstrap.cc:492] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:22.975894 8636 consensus_queue.cc:260] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:22.999503 8446 consensus_peers.cc:487] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:23.005597 8636 ts_tablet_manager.cc:1428] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.033s user 0.005s sys 0.000s
I20260812 19:27:23.012876 8623 tablet_bootstrap.cc:654] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.027225 8627 tablet_bootstrap.cc:700] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7: Time spent opening tablet: real 0.104s user 0.002s sys 0.002s
I20260812 19:27:23.028374 8627 tablet_bootstrap.cc:654] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.039494 8636 tablet_bootstrap.cc:492] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:23.059549 8636 tablet_bootstrap.cc:654] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.059769 9998 consensus_queue.cc:1035] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:23.102309 10068 raft_consensus.cc:482] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.102854 10068 raft_consensus.cc:504] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.106537 10068 leader_election.cc:288] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:23.128561 8443 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:23.129005 8443 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:23.140677 8623 tablet_bootstrap.cc:492] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:23.141139 8623 ts_tablet_manager.cc:1397] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.147s user 0.006s sys 0.006s
I20260812 19:27:23.145459 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c9d071f07e5410d9e660986ab6858ef" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:23.146168 8511 raft_consensus.cc:2379] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:23.144548 10013 raft_consensus.cc:2726] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:23.191061 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "613763d1b3074766bee2d026de516065" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:23.191763 8627 tablet_bootstrap.cc:492] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:23.192229 8627 ts_tablet_manager.cc:1397] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.364s user 0.008s sys 0.006s
I20260812 19:27:23.192499 10097 raft_consensus.cc:482] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.193003 10097 raft_consensus.cc:504] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.195065 8627 raft_consensus.cc:348] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.196815 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:23.206272 8623 raft_consensus.cc:348] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.207000 8623 raft_consensus.cc:374] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.207263 8623 raft_consensus.cc:729] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.207998 8623 consensus_queue.cc:260] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
W20260812 19:27:23.223855 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 93434.8us
I20260812 19:27:23.227658 10063 consensus_queue.cc:1035] T 867e426fedce4c9895b7b9a13f8bb5e3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:23.238498 8443 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 544d3d74baa6477da11abbee139ee66f
I20260812 19:27:23.238955 8443 leader_election.cc:302] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:23.239631 10138 raft_consensus.cc:2726] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:23.238047 8636 tablet_bootstrap.cc:492] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:23.240988 8636 ts_tablet_manager.cc:1397] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.202s user 0.017s sys 0.002s
I20260812 19:27:23.244516 8623 ts_tablet_manager.cc:1428] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.103s user 0.007s sys 0.001s
I20260812 19:27:23.245563 8623 tablet_bootstrap.cc:492] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:23.257336 10138 consensus_queue.cc:1035] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:23.262567 8446 consensus_peers.cc:487] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:27:23.263864 8636 raft_consensus.cc:348] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:23.264640 8636 raft_consensus.cc:374] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.264932 8636 raft_consensus.cc:729] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.265532 8636 consensus_queue.cc:260] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:23.268728 8636 ts_tablet_manager.cc:1428] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20260812 19:27:23.283573 10068 consensus_queue.cc:1035] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:23.198241 8281 leader_election.cc:341] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:23.292500 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 94287.7us
I20260812 19:27:23.198590 10097 leader_election.cc:288] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:23.232299 10090 raft_consensus.cc:482] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.295401 10090 raft_consensus.cc:504] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.297932 10090 leader_election.cc:288] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:23.284224 8623 tablet_bootstrap.cc:654] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.313076 8627 raft_consensus.cc:374] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.324285 8627 raft_consensus.cc:729] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.371291 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13607c1893434a728d989eb1c8c88eea" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:23.382099 8623 tablet_bootstrap.cc:492] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:23.382530 8623 ts_tablet_manager.cc:1397] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.137s user 0.007s sys 0.008s
W20260812 19:27:23.393115 8281 leader_election.cc:341] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:23.395457 10187 raft_consensus.cc:482] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.395951 10187 raft_consensus.cc:504] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.397928 10187 leader_election.cc:288] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:23.341078 8627 consensus_queue.cc:260] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.400929 8627 ts_tablet_manager.cc:1428] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.208s user 0.006s sys 0.001s
I20260812 19:27:23.384809 8623 raft_consensus.cc:348] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.402673 8623 raft_consensus.cc:374] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.402963 8623 raft_consensus.cc:729] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.403680 8623 consensus_queue.cc:260] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.404547 8636 tablet_bootstrap.cc:492] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:23.410241 8623 ts_tablet_manager.cc:1428] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20260812 19:27:23.412380 8623 tablet_bootstrap.cc:492] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:23.412503 8636 tablet_bootstrap.cc:654] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:23.416416 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 51258.4us
I20260812 19:27:23.452011 10195 raft_consensus.cc:482] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.456398 10195 raft_consensus.cc:504] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.458067 8636 tablet_bootstrap.cc:492] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:23.458513 8636 ts_tablet_manager.cc:1397] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.054s user 0.007s sys 0.004s
I20260812 19:27:23.458566 10195 leader_election.cc:288] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:23.460901 8627 tablet_bootstrap.cc:492] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:23.460757 8636 raft_consensus.cc:348] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:23.464535 8636 raft_consensus.cc:374] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.465467 8636 raft_consensus.cc:729] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
W20260812 19:27:23.466322 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 47695.3us
I20260812 19:27:23.467053 8636 consensus_queue.cc:260] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:23.473740 8636 ts_tablet_manager.cc:1428] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20260812 19:27:23.474128 8623 tablet_bootstrap.cc:654] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:23.474260 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 189901us
I20260812 19:27:23.476992 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:23.477591 8182 raft_consensus.cc:2454] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:23.477898 10063 consensus_queue.cc:1035] T e6ef4b3497284a799d4a4f45d7609e45 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:23.476948 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94407c13a91c4a76bd3aa1c1c8032384" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:23.480465 8172 raft_consensus.cc:2454] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:23.483739 8281 leader_election.cc:302] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:23.485631 10097 raft_consensus.cc:2781] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:23.485976 10097 raft_consensus.cc:482] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:23.486328 10097 raft_consensus.cc:3037] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:23.488549 10190 consensus_queue.cc:1035] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:23.495776 8278 leader_election.cc:341] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:23.500434 8278 leader_election.cc:302] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:23.501480 10190 raft_consensus.cc:2726] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:23.501828 7802 raft_consensus.cc:1261] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Refusing update from remote peer b99a815f68ee4d93b167a67778a3e1a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 320. Preceding OpId from leader: term: 5 index: 321. (index mismatch)
I20260812 19:27:23.504287 10178 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 321, Last known committed idx: 320, Time since last communication: 0.001s
I20260812 19:27:23.516645 10097 raft_consensus.cc:504] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.509909 8446 leader_election.cc:302] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:23.521579 10187 raft_consensus.cc:2781] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:23.521965 10187 raft_consensus.cc:482] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:23.522294 10187 raft_consensus.cc:3037] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:23.533833 8636 tablet_bootstrap.cc:492] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:23.534760 9424 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Refusing update from remote peer b99a815f68ee4d93b167a67778a3e1a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 320. Preceding OpId from leader: term: 5 index: 321. (index mismatch)
I20260812 19:27:23.535779 10187 raft_consensus.cc:504] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.536592 10178 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 321, Last known committed idx: 320, Time since last communication: 0.000s
I20260812 19:27:23.543494 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94407c13a91c4a76bd3aa1c1c8032384" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:23.544010 8182 raft_consensus.cc:3037] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:23.550266 8182 raft_consensus.cc:2454] T 94407c13a91c4a76bd3aa1c1c8032384 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:23.552896 8446 leader_election.cc:302] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
W20260812 19:27:23.562079 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.692s (SENT)
I20260812 19:27:23.553757 10013 raft_consensus.cc:2781] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:23.563691 10013 raft_consensus.cc:686] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:23.564503 10013 consensus_queue.cc:237] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.553282 10187 leader_election.cc:288] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:23.583431 10013 raft_consensus.cc:482] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.583979 10013 raft_consensus.cc:504] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.586301 10013 leader_election.cc:288] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:23.586948 10013 raft_consensus.cc:482] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.587487 10013 raft_consensus.cc:504] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:23.538875 8627 tablet_bootstrap.cc:654] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:23.556772 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 61031.6us
I20260812 19:27:23.596632 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:23.597198 8182 raft_consensus.cc:2454] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:23.598135 10097 leader_election.cc:288] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:23.599582 8636 tablet_bootstrap.cc:654] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.599696 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:23.600188 8182 raft_consensus.cc:3037] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:23.602380 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94407c13a91c4a76bd3aa1c1c8032384" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:23.603133 8350 raft_consensus.cc:2454] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:23.606288 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94407c13a91c4a76bd3aa1c1c8032384" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:23.606987 8350 raft_consensus.cc:3037] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:23.607470 8182 raft_consensus.cc:2454] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:23.609992 8446 leader_election.cc:302] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:23.610842 10187 raft_consensus.cc:2781] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:23.611181 10187 raft_consensus.cc:482] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:23.611604 10187 raft_consensus.cc:3037] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:23.616411 10190 raft_consensus.cc:482] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:23.616868 10190 raft_consensus.cc:504] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.617718 8281 leader_election.cc:302] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:23.618527 10090 raft_consensus.cc:2781] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:23.618876 10190 leader_election.cc:288] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:23.618952 10090 raft_consensus.cc:686] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:23.619712 10090 consensus_queue.cc:237] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.629433 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311b68f298164090bc9458e3ee16f6cb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:23.630649 8627 tablet_bootstrap.cc:492] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
W20260812 19:27:23.631266 8281 leader_election.cc:341] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:23.636487 8627 ts_tablet_manager.cc:1397] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.176s user 0.006s sys 0.005s
I20260812 19:27:23.653743 10013 leader_election.cc:288] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:23.664440 8627 raft_consensus.cc:348] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.665171 8627 raft_consensus.cc:374] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.665423 8627 raft_consensus.cc:729] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.667368 10200 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 5 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:23.668888 10200 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:23.671655 8627 consensus_queue.cc:260] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.674328 8627 ts_tablet_manager.cc:1428] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.037s user 0.005s sys 0.001s
I20260812 19:27:23.675158 8627 tablet_bootstrap.cc:492] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:23.680956 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff5b2d23d734217b0b10e50834b8883" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:23.684795 8446 leader_election.cc:341] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:23.693475 8636 tablet_bootstrap.cc:492] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:23.694013 8636 ts_tablet_manager.cc:1397] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.160s user 0.008s sys 0.003s
I20260812 19:27:23.678625 10187 raft_consensus.cc:504] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:23.697600 10203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b99a815f68ee4d93b167a67778a3e1a6. Latest consensus state: current_term: 5 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:23.698469 10203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:23.701814 10187 leader_election.cc:288] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:23.703905 8636 raft_consensus.cc:348] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.705615 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:23.706161 8636 raft_consensus.cc:374] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.706347 8182 raft_consensus.cc:2379] T a91c4d5adb3d4f97939e38e9cee79532 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:23.706457 8636 raft_consensus.cc:729] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.707885 8636 consensus_queue.cc:260] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:23.715965 8623 tablet_bootstrap.cc:492] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:23.716440 8623 ts_tablet_manager.cc:1397] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.304s user 0.008s sys 0.005s
I20260812 19:27:23.729283 8636 ts_tablet_manager.cc:1428] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.035s user 0.008s sys 0.000s
I20260812 19:27:23.724759 8623 raft_consensus.cc:348] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:23.734505 8623 raft_consensus.cc:374] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.735545 8636 tablet_bootstrap.cc:492] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:23.735945 8623 raft_consensus.cc:729] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.740882 10215 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:23.741844 10215 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
I20260812 19:27:23.742449 8623 consensus_queue.cc:260] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:23.761080 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.693s (SENT)
I20260812 19:27:23.761583 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:23.762401 10203 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260812 19:27:23.764029 8623 ts_tablet_manager.cc:1428] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20260812 19:27:23.792114 10200 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:23.792855 10200 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:23.795614 8623 tablet_bootstrap.cc:492] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:23.801364 8636 tablet_bootstrap.cc:654] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.827816 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:23.834098 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13607c1893434a728d989eb1c8c88eea" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:23.836845 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:23.837764 8510 raft_consensus.cc:2379] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:23.838531 8623 tablet_bootstrap.cc:654] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.865177 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311b68f298164090bc9458e3ee16f6cb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:23.716032 8627 tablet_bootstrap.cc:654] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:23.845623 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:23.850924 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:23.851979 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff5b2d23d734217b0b10e50834b8883" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:23.876477 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:23.877213 8516 raft_consensus.cc:2379] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:23.880158 10178 sys_catalog.cc:455] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:23.881023 10178 sys_catalog.cc:458] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [sys.catalog]: This master's current role is: LEADER
W20260812 19:27:23.881958 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 159351us
I20260812 19:27:23.618225 8350 raft_consensus.cc:2454] T 94407c13a91c4a76bd3aa1c1c8032384 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:23.897681 8347 raft_consensus.cc:2454] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:23.906455 10203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "b99a815f68ee4d93b167a67778a3e1a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:23.907276 10203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [sys.catalog]: This master's current role is: FOLLOWER
W20260812 19:27:23.954952 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 50390.2us
I20260812 19:27:23.960593 8623 tablet_bootstrap.cc:492] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:23.961828 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8c9d071f07e5410d9e660986ab6858ef" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:23.964927 8623 ts_tablet_manager.cc:1397] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.170s user 0.005s sys 0.012s
I20260812 19:27:23.968195 8177 raft_consensus.cc:3037] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:23.967573 8623 raft_consensus.cc:348] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:23.984625 8623 raft_consensus.cc:374] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:23.984969 8623 raft_consensus.cc:729] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:23.985617 8623 consensus_queue.cc:260] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.010452 8636 tablet_bootstrap.cc:492] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:24.010879 8636 ts_tablet_manager.cc:1397] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.276s user 0.007s sys 0.016s
I20260812 19:27:24.015057 8623 ts_tablet_manager.cc:1428] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.050s user 0.006s sys 0.001s
I20260812 19:27:24.015156 8636 raft_consensus.cc:348] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.016372 8636 raft_consensus.cc:374] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.020756 8636 raft_consensus.cc:729] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.021654 8636 consensus_queue.cc:260] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.029376 8623 tablet_bootstrap.cc:492] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:24.036038 8627 tablet_bootstrap.cc:492] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:24.036623 8627 ts_tablet_manager.cc:1397] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.362s user 0.010s sys 0.008s
I20260812 19:27:24.051762 8636 ts_tablet_manager.cc:1428] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.041s user 0.005s sys 0.001s
I20260812 19:27:24.052707 8636 tablet_bootstrap.cc:492] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:24.059214 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 61037.1us
I20260812 19:27:24.083489 10219 raft_consensus.cc:482] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.084141 10219 raft_consensus.cc:504] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.087419 8443 leader_election.cc:302] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.088552 8443 leader_election.cc:302] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:24.089412 10138 raft_consensus.cc:2781] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:24.089733 10138 raft_consensus.cc:482] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:24.089999 10138 raft_consensus.cc:3037] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.092414 10187 raft_consensus.cc:2726] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.094357 10192 consensus_queue.cc:1035] T b73ea5acf663420cbe9236c014d71199 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:24.099291 10138 raft_consensus.cc:504] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.101931 10138 leader_election.cc:288] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:24.103000 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff5b2d23d734217b0b10e50834b8883" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:24.103536 8180 raft_consensus.cc:3037] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.110446 8108 leader_election.cc:302] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:24.110903 8180 raft_consensus.cc:2454] T 6ff5b2d23d734217b0b10e50834b8883 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:24.111794 8446 leader_election.cc:302] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:24.112947 10213 raft_consensus.cc:2781] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:24.113503 10213 raft_consensus.cc:686] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:24.114409 10213 consensus_queue.cc:237] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.149703 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:24.086849 10219 leader_election.cc:288] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.155891 8636 tablet_bootstrap.cc:654] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:24.157634 10138 raft_consensus.cc:482] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.158138 10138 raft_consensus.cc:504] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.160430 10138 leader_election.cc:288] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:24.161767 10192 raft_consensus.cc:2726] T 8c9d071f07e5410d9e660986ab6858ef P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.170037 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da136cadb824d18886132c8f26ccb22" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:24.176092 8446 leader_election.cc:341] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.179844 8636 tablet_bootstrap.cc:492] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:24.180357 8636 ts_tablet_manager.cc:1397] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.128s user 0.012s sys 0.000s
I20260812 19:27:24.182615 8636 raft_consensus.cc:348] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.184186 8636 raft_consensus.cc:374] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.184525 8636 raft_consensus.cc:729] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.185122 8636 consensus_queue.cc:260] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.187150 8636 ts_tablet_manager.cc:1428] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260812 19:27:24.193343 8636 tablet_bootstrap.cc:492] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:24.199462 8636 tablet_bootstrap.cc:654] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:24.205855 8627 raft_consensus.cc:348] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.206651 8627 raft_consensus.cc:374] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.206936 8627 raft_consensus.cc:729] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:27:24.210323 8281 leader_election.cc:341] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.207559 8627 consensus_queue.cc:260] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.216739 8627 ts_tablet_manager.cc:1428] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.180s user 0.006s sys 0.001s
I20260812 19:27:24.219058 8627 tablet_bootstrap.cc:492] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:24.219710 10138 raft_consensus.cc:482] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.220281 10138 raft_consensus.cc:504] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.223562 10138 leader_election.cc:288] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.228680 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "613763d1b3074766bee2d026de516065" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:24.229892 8446 leader_election.cc:341] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.239674 8623 tablet_bootstrap.cc:654] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:24.206218 8278 leader_election.cc:341] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.288435 8278 leader_election.cc:302] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.289381 10090 raft_consensus.cc:2726] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:24.293588 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 87525.9us
W20260812 19:27:24.295519 8278 leader_election.cc:341] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.295943 8278 leader_election.cc:302] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.296857 10090 raft_consensus.cc:2726] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.298997 8627 tablet_bootstrap.cc:654] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:24.312564 8278 leader_election.cc:341] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.320394 8278 leader_election.cc:302] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.323899 10090 raft_consensus.cc:2726] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.341430 8627 tablet_bootstrap.cc:492] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:24.341984 8627 ts_tablet_manager.cc:1397] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.123s user 0.010s sys 0.001s
I20260812 19:27:24.344897 8627 raft_consensus.cc:348] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.350221 8623 tablet_bootstrap.cc:492] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:24.350612 8623 ts_tablet_manager.cc:1397] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.322s user 0.007s sys 0.003s
I20260812 19:27:24.350238 10090 raft_consensus.cc:482] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.351428 10090 raft_consensus.cc:504] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.354373 10192 raft_consensus.cc:482] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.354779 10192 raft_consensus.cc:504] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.356627 10192 leader_election.cc:288] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:24.353935 10090 leader_election.cc:288] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.357913 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:24.358358 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01063b51cc35482c918f74b43fa3ee8f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:24.359375 8281 leader_election.cc:341] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.359849 8627 raft_consensus.cc:374] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.360100 8627 raft_consensus.cc:729] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.360721 8627 consensus_queue.cc:260] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.368522 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d4d4e8d3d6ef40058b29f7cc574a5565" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:24.369851 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ff5b2d23d734217b0b10e50834b8883" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:24.370369 8349 raft_consensus.cc:3037] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.372757 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da136cadb824d18886132c8f26ccb22" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:24.373386 8345 raft_consensus.cc:2454] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:24.374171 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:24.374418 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "613763d1b3074766bee2d026de516065" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:24.375025 8344 raft_consensus.cc:2454] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:24.377844 8517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01063b51cc35482c918f74b43fa3ee8f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:24.394307 8627 ts_tablet_manager.cc:1428] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.052s user 0.004s sys 0.000s
I20260812 19:27:24.352870 8623 raft_consensus.cc:348] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.402052 8623 raft_consensus.cc:374] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.402374 8623 raft_consensus.cc:729] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.409493 8627 tablet_bootstrap.cc:492] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:24.412242 8349 raft_consensus.cc:2454] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:24.418053 8108 leader_election.cc:302] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:24.419687 10192 raft_consensus.cc:2726] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.412608 8623 consensus_queue.cc:260] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.424765 8443 leader_election.cc:302] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.425758 8443 leader_election.cc:302] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.426956 10187 raft_consensus.cc:2781] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:24.427276 10187 raft_consensus.cc:482] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:24.427578 10187 raft_consensus.cc:3037] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.430140 8623 ts_tablet_manager.cc:1428] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.079s user 0.003s sys 0.004s
I20260812 19:27:24.431080 8623 tablet_bootstrap.cc:492] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:24.432435 10058 raft_consensus.cc:2781] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:24.432780 10058 raft_consensus.cc:482] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:24.433082 10058 raft_consensus.cc:3037] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.441118 10058 raft_consensus.cc:504] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.443101 10187 raft_consensus.cc:504] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.445578 10058 leader_election.cc:288] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.446520 10187 leader_election.cc:288] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:24.446781 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "613763d1b3074766bee2d026de516065" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:24.447139 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da136cadb824d18886132c8f26ccb22" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:24.447649 8177 raft_consensus.cc:3037] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.455493 8177 raft_consensus.cc:2454] T 6da136cadb824d18886132c8f26ccb22 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:24.462353 10090 raft_consensus.cc:482] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.462775 10090 raft_consensus.cc:504] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.465581 10090 leader_election.cc:288] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.466365 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9815f0f40634d83a6c6a33b2ab198df" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:24.467605 8281 leader_election.cc:341] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:24.448079 8446 leader_election.cc:341] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.463749 10058 raft_consensus.cc:482] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.468247 10058 raft_consensus.cc:504] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.468801 8446 leader_election.cc:302] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:24.470049 10138 raft_consensus.cc:2781] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:24.470467 10138 raft_consensus.cc:686] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:24.470574 10058 leader_election.cc:288] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:24.471248 10138 consensus_queue.cc:237] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.473277 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ca59e00b52437a8d7ef06ebc194af3" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:24.474682 8446 leader_election.cc:341] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:24.461977 8278 leader_election.cc:341] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.478235 8636 tablet_bootstrap.cc:492] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:24.478638 8636 ts_tablet_manager.cc:1397] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.285s user 0.013s sys 0.005s
I20260812 19:27:24.481015 8636 raft_consensus.cc:348] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.478969 8278 leader_election.cc:302] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.481745 8636 raft_consensus.cc:374] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.482014 8636 raft_consensus.cc:729] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.482205 10090 raft_consensus.cc:2726] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.491358 10058 raft_consensus.cc:482] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260812 19:27:24.492686 8278 leader_election.cc:341] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.493196 8278 leader_election.cc:302] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.488296 8627 tablet_bootstrap.cc:654] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:24.494731 10090 raft_consensus.cc:2726] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.496923 8623 tablet_bootstrap.cc:654] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:24.497592 8636 consensus_queue.cc:260] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.499792 8636 ts_tablet_manager.cc:1428] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260812 19:27:24.491815 10058 raft_consensus.cc:504] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.520467 10213 raft_consensus.cc:482] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.520946 10213 raft_consensus.cc:504] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.522807 10213 leader_election.cc:288] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.527874 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "613763d1b3074766bee2d026de516065" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:24.528412 8352 raft_consensus.cc:3037] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.530260 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:24.531764 8446 leader_election.cc:341] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.540853 8352 raft_consensus.cc:2454] T 613763d1b3074766bee2d026de516065 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:24.544550 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6da136cadb824d18886132c8f26ccb22" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:24.545094 8352 raft_consensus.cc:3037] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.548635 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ca59e00b52437a8d7ef06ebc194af3" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:24.549273 8349 raft_consensus.cc:2454] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:24.550968 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:24.551499 8351 raft_consensus.cc:2454] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:24.557590 10058 leader_election.cc:288] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.560595 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:24.561790 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:24.561915 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9815f0f40634d83a6c6a33b2ab198df" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:24.562362 8350 raft_consensus.cc:2454] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
W20260812 19:27:24.563246 8446 leader_election.cc:341] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.569337 8623 tablet_bootstrap.cc:492] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:24.569811 8623 ts_tablet_manager.cc:1397] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.139s user 0.009s sys 0.000s
I20260812 19:27:24.578958 8443 leader_election.cc:302] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.579993 8443 leader_election.cc:302] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.581190 8443 leader_election.cc:302] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.583225 10213 raft_consensus.cc:2781] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:24.583671 10213 raft_consensus.cc:686] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:24.584385 10090 raft_consensus.cc:482] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.584534 10187 raft_consensus.cc:2781] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:24.584890 10187 raft_consensus.cc:482] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:24.585191 8627 tablet_bootstrap.cc:492] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:24.585180 10187 raft_consensus.cc:3037] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.584870 10090 raft_consensus.cc:504] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.585558 8627 ts_tablet_manager.cc:1397] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.176s user 0.010s sys 0.001s
I20260812 19:27:24.586714 10090 leader_election.cc:288] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.587769 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622deb66eead473189ab85a53cb8c81f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:24.589468 8281 leader_election.cc:341] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.572135 8623 raft_consensus.cc:348] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.603303 8623 raft_consensus.cc:374] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.603621 8623 raft_consensus.cc:729] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.604478 8623 consensus_queue.cc:260] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.606139 8623 ts_tablet_manager.cc:1428] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.036s user 0.006s sys 0.000s
I20260812 19:27:24.607108 8623 tablet_bootstrap.cc:492] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:24.610167 8627 raft_consensus.cc:348] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.610937 8627 raft_consensus.cc:374] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.611239 8627 raft_consensus.cc:729] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.611841 8627 consensus_queue.cc:260] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.621233 10213 consensus_queue.cc:237] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.622844 8352 raft_consensus.cc:2454] T 6da136cadb824d18886132c8f26ccb22 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
W20260812 19:27:24.628099 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 46972.2us
I20260812 19:27:24.624820 10058 raft_consensus.cc:2781] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:24.635581 10058 raft_consensus.cc:482] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:24.635898 10058 raft_consensus.cc:3037] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.636607 8636 tablet_bootstrap.cc:492] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:24.638774 8278 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 58958.2us
I20260812 19:27:24.657382 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622deb66eead473189ab85a53cb8c81f" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:24.662595 8443 leader_election.cc:302] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.664711 10213 raft_consensus.cc:2781] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:24.665095 10213 raft_consensus.cc:482] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:24.665480 10213 raft_consensus.cc:3037] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.677173 10090 consensus_queue.cc:1035] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:24.637434 10187 raft_consensus.cc:504] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.708503 8623 tablet_bootstrap.cc:654] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:24.709579 10187 leader_election.cc:288] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:24.713794 8636 tablet_bootstrap.cc:654] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:24.653736 8627 ts_tablet_manager.cc:1428] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.068s user 0.006s sys 0.000s
I20260812 19:27:24.729650 10058 raft_consensus.cc:504] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:24.730114 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 70928.1us
I20260812 19:27:24.735232 10213 raft_consensus.cc:504] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.743065 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ca59e00b52437a8d7ef06ebc194af3" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:24.743741 8177 raft_consensus.cc:3037] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.748396 10213 leader_election.cc:288] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.749019 10058 leader_election.cc:288] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:24.764269 8627 tablet_bootstrap.cc:492] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:24.770346 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:24.767891 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:24.773772 8177 raft_consensus.cc:2454] T 69ca59e00b52437a8d7ef06ebc194af3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
W20260812 19:27:24.777074 8278 leader_election.cc:341] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.779937 8278 leader_election.cc:302] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.782584 10090 raft_consensus.cc:2726] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.783587 8627 tablet_bootstrap.cc:654] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:24.784130 8446 leader_election.cc:341] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:24.784830 8446 leader_election.cc:341] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.785372 8446 leader_election.cc:302] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:24.788414 10058 consensus_queue.cc:1035] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:24.789390 10213 raft_consensus.cc:2781] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:24.790243 10213 raft_consensus.cc:686] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:24.791008 10213 consensus_queue.cc:237] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:24.799712 8636 tablet_bootstrap.cc:492] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
W20260812 19:27:24.817140 8278 leader_election.cc:341] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:24.817811 8636 ts_tablet_manager.cc:1397] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.181s user 0.011s sys 0.003s
I20260812 19:27:24.818166 8623 tablet_bootstrap.cc:492] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:24.818624 8623 ts_tablet_manager.cc:1397] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.212s user 0.005s sys 0.005s
I20260812 19:27:24.820837 8636 raft_consensus.cc:348] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.821609 8278 leader_election.cc:302] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:24.821411 8623 raft_consensus.cc:348] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.822117 8623 raft_consensus.cc:374] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.822351 8623 raft_consensus.cc:729] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.823017 8623 consensus_queue.cc:260] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.824961 10219 raft_consensus.cc:2726] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:24.843859 8636 raft_consensus.cc:374] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.844276 8636 raft_consensus.cc:729] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.844941 8636 consensus_queue.cc:260] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.860219 8623 ts_tablet_manager.cc:1428] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.041s user 0.006s sys 0.001s
I20260812 19:27:24.861191 8623 tablet_bootstrap.cc:492] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:24.882308 8636 ts_tablet_manager.cc:1428] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.063s user 0.005s sys 0.000s
I20260812 19:27:24.896793 8627 tablet_bootstrap.cc:492] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:24.897330 8627 ts_tablet_manager.cc:1397] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.133s user 0.006s sys 0.005s
I20260812 19:27:24.898509 8623 tablet_bootstrap.cc:654] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:24.900511 8627 raft_consensus.cc:348] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.901338 8627 raft_consensus.cc:374] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:24.901643 8627 raft_consensus.cc:729] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:24.902359 8627 consensus_queue.cc:260] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.895588 10259 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:24.907724 10259 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:24.910115 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69ca59e00b52437a8d7ef06ebc194af3" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:24.910699 8351 raft_consensus.cc:3037] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.910586 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:24.917798 8351 raft_consensus.cc:2454] T 69ca59e00b52437a8d7ef06ebc194af3 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:24.925383 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:24.925978 8352 raft_consensus.cc:3037] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.937292 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:24.938226 10249 raft_consensus.cc:482] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:24.938700 10249 raft_consensus.cc:504] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:24.940727 10249 leader_election.cc:288] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:24.941579 8351 raft_consensus.cc:3037] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:24.942386 10259 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:24.948799 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:24.949579 8516 raft_consensus.cc:2379] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:24.954221 8636 tablet_bootstrap.cc:492] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:24.968338 10058 consensus_queue.cc:1035] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:24.981962 8352 raft_consensus.cc:2454] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:24.997320 10090 consensus_queue.cc:1035] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:25.000382 8627 ts_tablet_manager.cc:1428] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.103s user 0.005s sys 0.000s
I20260812 19:27:25.010181 8443 leader_election.cc:302] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:25.011160 10058 raft_consensus.cc:2781] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:25.011819 10058 raft_consensus.cc:686] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:25.012594 10058 consensus_queue.cc:237] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.021299 10213 raft_consensus.cc:482] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:25.021704 10213 raft_consensus.cc:504] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.023468 10213 leader_election.cc:288] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:25.034534 8627 tablet_bootstrap.cc:492] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:25.040913 8172 raft_consensus.cc:3037] T d4d4e8d3d6ef40058b29f7cc574a5565 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.040915 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:25.042280 8446 leader_election.cc:341] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.043558 8351 raft_consensus.cc:2454] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:25.056365 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:25.057025 8352 raft_consensus.cc:2454] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:25.059346 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:25.060045 8352 raft_consensus.cc:2379] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:25.069083 8636 tablet_bootstrap.cc:654] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.078883 8108 leader_election.cc:302] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:25.088764 10234 raft_consensus.cc:3037] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.113317 8627 tablet_bootstrap.cc:654] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.120914 10234 raft_consensus.cc:2726] T f093c8ebbcae4d33918a3c9f30eabb5a P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:25.126295 8623 tablet_bootstrap.cc:492] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:25.126735 8623 ts_tablet_manager.cc:1397] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.266s user 0.007s sys 0.001s
I20260812 19:27:25.129016 8623 raft_consensus.cc:348] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.130208 8623 raft_consensus.cc:374] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.130456 8623 raft_consensus.cc:729] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:25.131062 8623 consensus_queue.cc:260] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.132512 8623 ts_tablet_manager.cc:1428] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260812 19:27:25.187682 10270 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:25.188230 10270 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:25.202168 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:25.205116 8443 leader_election.cc:302] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:25.207249 8443 leader_election.cc:302] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:25.233309 8623 tablet_bootstrap.cc:492] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:25.244131 10187 raft_consensus.cc:2781] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:25.244786 10187 raft_consensus.cc:482] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:25.245155 10187 raft_consensus.cc:3037] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.245985 8636 tablet_bootstrap.cc:492] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:25.246742 8636 ts_tablet_manager.cc:1397] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.293s user 0.008s sys 0.001s
I20260812 19:27:25.254174 10138 raft_consensus.cc:2781] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:25.254757 10138 raft_consensus.cc:686] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:25.255920 10138 consensus_queue.cc:237] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.285640 8636 raft_consensus.cc:348] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.286535 8636 raft_consensus.cc:374] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.286868 8636 raft_consensus.cc:729] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:25.293979 8623 tablet_bootstrap.cc:654] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.301977 10270 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:25.309422 8627 tablet_bootstrap.cc:492] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:25.309957 8627 ts_tablet_manager.cc:1397] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.276s user 0.011s sys 0.006s
I20260812 19:27:25.316671 8636 consensus_queue.cc:260] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.318645 8636 ts_tablet_manager.cc:1428] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.072s user 0.009s sys 0.000s
I20260812 19:27:25.335057 10271 raft_consensus.cc:482] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:25.335640 10271 raft_consensus.cc:504] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.338470 10271 leader_election.cc:288] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:25.339139 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13607c1893434a728d989eb1c8c88eea" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:25.340700 8446 leader_election.cc:341] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.342731 10187 raft_consensus.cc:504] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.381628 8627 raft_consensus.cc:348] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.382349 8627 raft_consensus.cc:374] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.382608 8627 raft_consensus.cc:729] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:25.383296 8627 consensus_queue.cc:260] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.390283 8636 tablet_bootstrap.cc:492] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:25.419643 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 191550us
I20260812 19:27:25.421686 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13607c1893434a728d989eb1c8c88eea" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:25.422405 8352 raft_consensus.cc:2454] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:25.424446 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:25.425005 8352 raft_consensus.cc:3037] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.432179 8627 ts_tablet_manager.cc:1428] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.122s user 0.005s sys 0.000s
I20260812 19:27:25.432710 8352 raft_consensus.cc:2454] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:25.435909 10213 consensus_queue.cc:1035] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:25.438220 10213 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:25.438812 10213 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:25.441577 10213 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:25.447257 8443 leader_election.cc:302] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:27:25.447834 8446 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:25.448084 10138 raft_consensus.cc:2781] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:25.448585 10138 raft_consensus.cc:482] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:25.449842 10138 raft_consensus.cc:3037] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.452787 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:25.454113 8446 leader_election.cc:341] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.455896 8623 tablet_bootstrap.cc:492] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:25.456350 8623 ts_tablet_manager.cc:1397] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.223s user 0.011s sys 0.000s
I20260812 19:27:25.457104 8443 leader_election.cc:302] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:25.458588 8623 raft_consensus.cc:348] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.459270 8623 raft_consensus.cc:374] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.459506 8623 raft_consensus.cc:729] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:25.459798 10058 consensus_queue.cc:1035] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:25.460358 10187 leader_election.cc:288] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:25.460222 8623 consensus_queue.cc:260] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.460866 10187 raft_consensus.cc:2781] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:25.461288 10187 raft_consensus.cc:686] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:25.462069 10058 consensus_queue.cc:1035] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:25.462033 10187 consensus_queue.cc:237] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.464341 10138 raft_consensus.cc:504] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:25.466013 8443 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:25.468549 8443 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:25.468598 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13607c1893434a728d989eb1c8c88eea" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:25.475039 10271 raft_consensus.cc:2726] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 19:27:25.469787 8446 leader_election.cc:341] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.479920 10138 leader_election.cc:288] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:25.481199 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13607c1893434a728d989eb1c8c88eea" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:25.481760 8351 raft_consensus.cc:3037] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.488837 8351 raft_consensus.cc:2454] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:25.495296 8636 tablet_bootstrap.cc:654] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.490264 8443 leader_election.cc:302] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:25.501165 10138 raft_consensus.cc:2781] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:25.502012 10138 raft_consensus.cc:686] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:25.503051 10138 consensus_queue.cc:237] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.524369 8627 tablet_bootstrap.cc:492] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:25.531725 10138 consensus_queue.cc:1035] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:25.548000 8623 ts_tablet_manager.cc:1428] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.091s user 0.005s sys 0.000s
I20260812 19:27:25.548977 8623 tablet_bootstrap.cc:492] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:25.552567 8446 consensus_peers.cc:487] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:25.559049 10272 consensus_queue.cc:1035] T 613763d1b3074766bee2d026de516065 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:25.564375 8627 tablet_bootstrap.cc:654] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.583101 8636 tablet_bootstrap.cc:492] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:25.583523 8636 ts_tablet_manager.cc:1397] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.194s user 0.001s sys 0.010s
I20260812 19:27:25.585785 8636 raft_consensus.cc:348] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.586462 8636 raft_consensus.cc:374] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.586705 8636 raft_consensus.cc:729] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:25.600951 10138 raft_consensus.cc:482] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:25.601506 10138 raft_consensus.cc:504] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.604110 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:25.604682 8352 raft_consensus.cc:2454] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:25.605547 8443 leader_election.cc:302] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:25.606258 10271 raft_consensus.cc:2781] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:25.606628 10271 raft_consensus.cc:482] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:25.606927 10271 raft_consensus.cc:3037] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.619233 10192 raft_consensus.cc:482] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:25.619753 10192 raft_consensus.cc:504] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.623678 10090 raft_consensus.cc:482] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:25.624166 10090 raft_consensus.cc:504] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.626266 10090 leader_election.cc:288] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:25.628474 10271 raft_consensus.cc:504] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.631027 10271 leader_election.cc:288] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:25.631767 10138 leader_election.cc:288] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:25.633596 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:25.636032 8278 leader_election.cc:341] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.644512 10192 leader_election.cc:288] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:25.646662 8623 tablet_bootstrap.cc:654] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.650758 8636 consensus_queue.cc:260] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.652737 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:25.653478 8627 tablet_bootstrap.cc:492] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:25.655992 8627 ts_tablet_manager.cc:1397] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.132s user 0.010s sys 0.000s
W20260812 19:27:25.660353 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 106534us
I20260812 19:27:25.664666 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:25.666715 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2175811e6a7646c3ae82daaa8c626bca" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:25.670248 8347 raft_consensus.cc:2379] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
W20260812 19:27:25.673086 8281 leader_election.cc:341] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.673550 8281 leader_election.cc:302] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:25.674510 8636 ts_tablet_manager.cc:1428] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.091s user 0.005s sys 0.001s
I20260812 19:27:25.674674 10090 raft_consensus.cc:2726] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:25.689280 8636 tablet_bootstrap.cc:492] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:25.695612 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:25.696614 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:25.718662 8636 tablet_bootstrap.cc:654] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.719200 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:25.719815 8356 raft_consensus.cc:3037] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:25.732892 8356 raft_consensus.cc:2454] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:25.752931 10234 raft_consensus.cc:482] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:25.753564 10234 raft_consensus.cc:504] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.756834 10234 leader_election.cc:288] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:25.761190 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:25.766141 8108 leader_election.cc:302] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:25.800796 8636 tablet_bootstrap.cc:492] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:25.813019 10249 raft_consensus.cc:3037] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:25.817049 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 190161us
I20260812 19:27:25.821769 10249 raft_consensus.cc:2726] T 2175811e6a7646c3ae82daaa8c626bca P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:25.825177 8446 leader_election.cc:341] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.827886 10187 consensus_queue.cc:1035] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:25.829939 8446 leader_election.cc:341] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:25.845697 8636 ts_tablet_manager.cc:1397] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.162s user 0.010s sys 0.001s
W20260812 19:27:25.854305 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 46740.9us
I20260812 19:27:25.858700 8636 raft_consensus.cc:348] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.865249 8636 raft_consensus.cc:374] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.872453 8636 raft_consensus.cc:729] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
W20260812 19:27:25.876899 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 70252.3us
I20260812 19:27:25.878612 8636 consensus_queue.cc:260] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.883349 8636 ts_tablet_manager.cc:1428] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.036s user 0.001s sys 0.004s
W20260812 19:27:25.891180 8278 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 49863.5us
I20260812 19:27:25.892423 8623 tablet_bootstrap.cc:492] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:25.892928 8623 ts_tablet_manager.cc:1397] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.344s user 0.024s sys 0.014s
I20260812 19:27:25.899164 8623 raft_consensus.cc:348] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.902774 8636 tablet_bootstrap.cc:492] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:25.903051 8623 raft_consensus.cc:374] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.903388 8623 raft_consensus.cc:729] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:25.907545 8623 consensus_queue.cc:260] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.916544 8623 ts_tablet_manager.cc:1428] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.023s user 0.005s sys 0.001s
I20260812 19:27:25.916901 8443 leader_election.cc:302] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:25.917428 8623 tablet_bootstrap.cc:492] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:25.917889 10272 raft_consensus.cc:2781] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:25.918826 10272 raft_consensus.cc:686] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:25.672869 8627 raft_consensus.cc:348] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.922541 8627 raft_consensus.cc:374] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:25.922961 8627 raft_consensus.cc:729] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:25.923607 8627 consensus_queue.cc:260] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.919620 10272 consensus_queue.cc:237] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:25.947402 8623 tablet_bootstrap.cc:654] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.969039 8636 tablet_bootstrap.cc:654] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.975384 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:25.976454 8356 raft_consensus.cc:2379] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:25.989329 8627 ts_tablet_manager.cc:1428] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.318s user 0.005s sys 0.000s
I20260812 19:27:25.990398 8627 tablet_bootstrap.cc:492] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:25.991642 8636 tablet_bootstrap.cc:492] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:25.992076 8636 ts_tablet_manager.cc:1397] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.003s
I20260812 19:27:25.996009 8627 tablet_bootstrap.cc:654] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:25.996338 8636 raft_consensus.cc:348] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.001542 8636 raft_consensus.cc:374] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.001827 8636 raft_consensus.cc:729] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.002527 8636 consensus_queue.cc:260] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.005669 8636 ts_tablet_manager.cc:1428] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20260812 19:27:26.009807 8623 tablet_bootstrap.cc:492] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:26.010212 8623 ts_tablet_manager.cc:1397] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.093s user 0.008s sys 0.003s
I20260812 19:27:26.014869 8623 raft_consensus.cc:348] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.015614 8623 raft_consensus.cc:374] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.015846 8623 raft_consensus.cc:729] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.016558 8623 consensus_queue.cc:260] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:26.020599 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 87320.9us
I20260812 19:27:26.023991 8623 ts_tablet_manager.cc:1428] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20260812 19:27:26.026103 8623 tablet_bootstrap.cc:492] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:26.036587 10187 consensus_queue.cc:1035] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.049540 8623 tablet_bootstrap.cc:654] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.055356 8108 leader_election.cc:302] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:26.074532 10234 raft_consensus.cc:3037] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.100803 8636 tablet_bootstrap.cc:492] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:26.103555 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 48289.7us
I20260812 19:27:26.104790 8623 tablet_bootstrap.cc:492] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:26.105180 8623 ts_tablet_manager.cc:1397] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.079s user 0.016s sys 0.002s
I20260812 19:27:26.109433 8636 tablet_bootstrap.cc:654] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.112474 8623 raft_consensus.cc:348] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.113154 8623 raft_consensus.cc:374] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.113421 8623 raft_consensus.cc:729] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.114058 8623 consensus_queue.cc:260] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.120498 8623 ts_tablet_manager.cc:1428] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20260812 19:27:26.135032 8636 tablet_bootstrap.cc:492] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:26.135502 8636 ts_tablet_manager.cc:1397] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.035s user 0.008s sys 0.002s
I20260812 19:27:26.137686 8636 raft_consensus.cc:348] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.138320 8636 raft_consensus.cc:374] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.138547 8636 raft_consensus.cc:729] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.139074 8636 consensus_queue.cc:260] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.140966 8623 tablet_bootstrap.cc:492] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:26.151890 10234 raft_consensus.cc:2726] T e0451c2d5d6b4851a83ee9d30aa40a6c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:26.159829 8636 ts_tablet_manager.cc:1428] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260812 19:27:26.160972 8636 tablet_bootstrap.cc:492] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:26.166101 8636 tablet_bootstrap.cc:654] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.158053 8623 tablet_bootstrap.cc:654] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.179643 10272 raft_consensus.cc:482] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.180420 10272 raft_consensus.cc:504] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.190730 8636 tablet_bootstrap.cc:492] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:26.191138 8636 ts_tablet_manager.cc:1397] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.000s
I20260812 19:27:26.191229 10138 consensus_queue.cc:1035] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.198042 10272 leader_election.cc:288] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.201948 8623 tablet_bootstrap.cc:492] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:26.202829 8623 ts_tablet_manager.cc:1397] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.062s user 0.007s sys 0.010s
I20260812 19:27:26.196864 8636 raft_consensus.cc:348] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.205101 8636 raft_consensus.cc:374] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.205345 8636 raft_consensus.cc:729] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.205907 8636 consensus_queue.cc:260] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.209321 8636 ts_tablet_manager.cc:1428] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20260812 19:27:26.050657 10090 raft_consensus.cc:482] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.212198 10090 raft_consensus.cc:504] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.213737 8636 tablet_bootstrap.cc:492] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:26.213827 10138 raft_consensus.cc:482] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.214207 10090 leader_election.cc:288] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.105921 10219 raft_consensus.cc:482] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.214274 10138 raft_consensus.cc:504] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.214759 10219 raft_consensus.cc:504] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.217118 10138 leader_election.cc:288] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.217707 10219 leader_election.cc:288] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.220007 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5e92063f494c79be75371f2626b1e3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:26.221551 8281 leader_election.cc:341] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:26.220049 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fac74fcb73d1489f8542496293d6141c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:26.227980 8623 raft_consensus.cc:348] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.228680 8623 raft_consensus.cc:374] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.228929 8623 raft_consensus.cc:729] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.229529 8623 consensus_queue.cc:260] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.231959 8623 ts_tablet_manager.cc:1428] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
W20260812 19:27:26.239037 8281 leader_election.cc:341] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:26.268482 8636 tablet_bootstrap.cc:654] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.271202 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01063b51cc35482c918f74b43fa3ee8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:26.271816 8182 raft_consensus.cc:2454] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.281422 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622deb66eead473189ab85a53cb8c81f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:26.285434 8446 leader_election.cc:302] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:26.286602 10272 raft_consensus.cc:2781] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:26.287021 10272 raft_consensus.cc:482] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:26.287413 10272 raft_consensus.cc:3037] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.294356 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01063b51cc35482c918f74b43fa3ee8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:26.294953 8347 raft_consensus.cc:2454] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.295482 10138 consensus_queue.cc:1035] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:26.298251 8446 leader_election.cc:341] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:26.313316 8627 tablet_bootstrap.cc:492] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:26.313725 8627 ts_tablet_manager.cc:1397] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.324s user 0.009s sys 0.001s
I20260812 19:27:26.315014 10272 raft_consensus.cc:504] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.323256 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622deb66eead473189ab85a53cb8c81f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:26.323908 8349 raft_consensus.cc:2454] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.332180 8623 tablet_bootstrap.cc:492] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:26.337942 8623 tablet_bootstrap.cc:654] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.371541 8623 tablet_bootstrap.cc:492] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:26.371987 8623 ts_tablet_manager.cc:1397] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.003s
I20260812 19:27:26.374464 8623 raft_consensus.cc:348] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.375205 8623 raft_consensus.cc:374] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.375492 8623 raft_consensus.cc:729] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.325981 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fac74fcb73d1489f8542496293d6141c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:26.326725 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5e92063f494c79be75371f2626b1e3" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:26.379659 10187 consensus_queue.cc:1035] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.380833 10272 leader_election.cc:288] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.386876 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01063b51cc35482c918f74b43fa3ee8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:26.387722 8172 raft_consensus.cc:3037] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.392737 8182 raft_consensus.cc:3037] T 13607c1893434a728d989eb1c8c88eea P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.400400 10187 consensus_queue.cc:1035] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.404366 8623 consensus_queue.cc:260] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.415238 8623 ts_tablet_manager.cc:1428] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.043s user 0.008s sys 0.000s
I20260812 19:27:26.415298 8172 raft_consensus.cc:2454] T 01063b51cc35482c918f74b43fa3ee8f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:26.416227 8623 tablet_bootstrap.cc:492] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:26.420549 8446 leader_election.cc:302] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:26.421393 10187 raft_consensus.cc:2781] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:26.421872 10187 raft_consensus.cc:686] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:26.422673 10187 consensus_queue.cc:237] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.436594 8623 tablet_bootstrap.cc:654] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.472357 10249 raft_consensus.cc:482] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.472813 10249 raft_consensus.cc:504] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.474659 10249 leader_election.cc:288] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:26.476052 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:26.477245 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.598s (SENT)
I20260812 19:27:26.477663 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:26.481967 8623 tablet_bootstrap.cc:492] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:26.492058 8623 ts_tablet_manager.cc:1397] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.076s user 0.007s sys 0.004s
I20260812 19:27:26.494650 10187 raft_consensus.cc:482] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.495201 10187 raft_consensus.cc:504] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.316154 8627 raft_consensus.cc:348] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.498229 8627 raft_consensus.cc:374] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.498728 8627 raft_consensus.cc:729] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.499686 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9815f0f40634d83a6c6a33b2ab198df" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:26.500358 8177 raft_consensus.cc:2454] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.501102 8636 tablet_bootstrap.cc:492] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:26.501513 8636 ts_tablet_manager.cc:1397] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.288s user 0.043s sys 0.020s
I20260812 19:27:26.501628 8446 leader_election.cc:302] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:26.502403 10272 raft_consensus.cc:2781] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:26.502719 10272 raft_consensus.cc:482] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:26.503001 10272 raft_consensus.cc:3037] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.505084 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db9e00d07964bde9f769e217236a771" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:26.505923 8347 raft_consensus.cc:2379] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:26.499080 10187 leader_election.cc:288] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.503870 8636 raft_consensus.cc:348] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.511447 8636 raft_consensus.cc:374] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.511726 8636 raft_consensus.cc:729] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.513490 8636 consensus_queue.cc:260] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.513854 10272 raft_consensus.cc:504] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.517701 8636 ts_tablet_manager.cc:1428] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260812 19:27:26.519742 10138 raft_consensus.cc:482] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.520171 10138 raft_consensus.cc:504] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.522121 10138 leader_election.cc:288] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.523397 10187 consensus_queue.cc:1035] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.544690 10138 raft_consensus.cc:482] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:26.545212 10138 raft_consensus.cc:504] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.547241 10138 leader_election.cc:288] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.549609 8623 raft_consensus.cc:348] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.553881 10272 leader_election.cc:288] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:26.569763 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 50387.8us
W20260812 19:27:26.573709 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.683s (SENT)
I20260812 19:27:26.574368 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:26.582933 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01063b51cc35482c918f74b43fa3ee8f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:26.583524 8347 raft_consensus.cc:3037] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.559631 8108 leader_election.cc:302] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:26.592104 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311b68f298164090bc9458e3ee16f6cb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:26.592670 10192 raft_consensus.cc:3037] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.597124 8347 raft_consensus.cc:2454] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:26.500315 8627 consensus_queue.cc:260] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.601660 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a53a91dc9e41d58ee4f6a083ca204c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:26.601845 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9815f0f40634d83a6c6a33b2ab198df" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:26.602469 8176 raft_consensus.cc:3037] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.603273 8627 ts_tablet_manager.cc:1428] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.289s user 0.008s sys 0.000s
I20260812 19:27:26.605093 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9815f0f40634d83a6c6a33b2ab198df" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:26.605697 8344 raft_consensus.cc:2454] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.607414 8178 raft_consensus.cc:3037] T 613763d1b3074766bee2d026de516065 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.607414 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9815f0f40634d83a6c6a33b2ab198df" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:26.607913 8344 raft_consensus.cc:3037] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.618863 10272 consensus_queue.cc:1035] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.622105 8344 raft_consensus.cc:2454] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:26.623019 8176 raft_consensus.cc:2454] T e9815f0f40634d83a6c6a33b2ab198df P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:26.624416 10192 raft_consensus.cc:2726] T 5db9e00d07964bde9f769e217236a771 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:26.625412 8623 raft_consensus.cc:374] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:27:26.615813 8446 leader_election.cc:341] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:26.625883 8623 raft_consensus.cc:729] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.626734 8446 leader_election.cc:302] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
W20260812 19:27:26.628866 8278 leader_election.cc:341] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:26.630365 8278 leader_election.cc:302] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:26.631060 10090 raft_consensus.cc:2726] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:26.631443 8278 leader_election.cc:341] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:26.631815 8278 leader_election.cc:302] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:26.632503 10090 raft_consensus.cc:2726] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:26.632388 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 58882.2us
I20260812 19:27:26.633556 8623 consensus_queue.cc:260] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.634545 10322 raft_consensus.cc:2781] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:26.634547 8177 raft_consensus.cc:2454] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.634956 10322 raft_consensus.cc:686] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:26.635744 10322 consensus_queue.cc:237] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.638510 8623 ts_tablet_manager.cc:1428] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.145s user 0.005s sys 0.000s
I20260812 19:27:26.639513 8623 tablet_bootstrap.cc:492] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:26.645246 10321 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:27:26.647166 8446 leader_election.cc:302] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:26.647455 10325 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:27:26.649137 10138 raft_consensus.cc:2781] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:26.649511 10138 raft_consensus.cc:482] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:26.649863 10138 raft_consensus.cc:3037] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:26.646006 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 168788us
I20260812 19:27:26.653033 8443 leader_election.cc:302] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:26.656332 8636 tablet_bootstrap.cc:492] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:26.657267 10138 raft_consensus.cc:504] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:26.686435 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 53406.1us
I20260812 19:27:26.692148 8623 tablet_bootstrap.cc:654] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.715936 8623 tablet_bootstrap.cc:492] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:26.716462 8623 ts_tablet_manager.cc:1397] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.077s user 0.010s sys 0.004s
I20260812 19:27:26.718595 8623 raft_consensus.cc:348] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.719300 8623 raft_consensus.cc:374] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.719596 8623 raft_consensus.cc:729] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.720296 8623 consensus_queue.cc:260] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.721881 8623 ts_tablet_manager.cc:1428] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260812 19:27:26.726264 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311b68f298164090bc9458e3ee16f6cb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:26.726855 8349 raft_consensus.cc:2454] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.731564 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a53a91dc9e41d58ee4f6a083ca204c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:26.732154 8347 raft_consensus.cc:2454] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:26.734248 8627 tablet_bootstrap.cc:492] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:26.743633 8623 tablet_bootstrap.cc:492] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:26.749217 8623 tablet_bootstrap.cc:654] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.763156 8636 tablet_bootstrap.cc:654] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.769212 10323 raft_consensus.cc:2781] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:26.769656 10323 raft_consensus.cc:482] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:26.770013 10323 raft_consensus.cc:3037] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.771773 10138 leader_election.cc:288] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.791707 10323 raft_consensus.cc:504] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.806576 10323 leader_election.cc:288] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.808990 8623 tablet_bootstrap.cc:492] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:26.809377 8623 ts_tablet_manager.cc:1397] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.066s user 0.004s sys 0.008s
I20260812 19:27:26.809850 8627 tablet_bootstrap.cc:654] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:26.816223 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 163279us
I20260812 19:27:26.818034 8636 tablet_bootstrap.cc:492] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:26.818446 8636 ts_tablet_manager.cc:1397] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.162s user 0.011s sys 0.003s
I20260812 19:27:26.829242 8636 raft_consensus.cc:348] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.829923 8636 raft_consensus.cc:374] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.830153 8636 raft_consensus.cc:729] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.830750 8636 consensus_queue.cc:260] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.842926 8623 raft_consensus.cc:348] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.843633 8623 raft_consensus.cc:374] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.843889 8623 raft_consensus.cc:729] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.844472 8623 consensus_queue.cc:260] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.855526 8623 ts_tablet_manager.cc:1428] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.046s user 0.003s sys 0.004s
I20260812 19:27:26.859086 10138 consensus_queue.cc:1035] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.866297 8636 ts_tablet_manager.cc:1428] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.048s user 0.004s sys 0.002s
I20260812 19:27:26.872767 8636 tablet_bootstrap.cc:492] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:26.881384 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 52382.6us
I20260812 19:27:26.883248 8636 tablet_bootstrap.cc:654] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.883755 8443 leader_election.cc:302] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:26.894968 10138 raft_consensus.cc:2781] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:26.895493 10138 raft_consensus.cc:482] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:26.895984 10138 raft_consensus.cc:3037] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:26.896661 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet ed3743a7dde744668cbe91759a499805 consensus state has no leader
I20260812 19:27:26.920519 8627 tablet_bootstrap.cc:492] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:26.920965 8627 ts_tablet_manager.cc:1397] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.187s user 0.010s sys 0.000s
I20260812 19:27:26.921864 10187 raft_consensus.cc:482] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:26.922459 10187 raft_consensus.cc:504] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:26.925925 10187 leader_election.cc:288] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:26.935760 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311b68f298164090bc9458e3ee16f6cb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:26.936375 8347 raft_consensus.cc:3037] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.938771 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622deb66eead473189ab85a53cb8c81f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:26.939323 8349 raft_consensus.cc:3037] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.940358 10138 raft_consensus.cc:504] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.950639 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a53a91dc9e41d58ee4f6a083ca204c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:26.951196 8352 raft_consensus.cc:3037] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.952839 10138 leader_election.cc:288] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:26.957580 8347 raft_consensus.cc:2454] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:26.962481 8349 raft_consensus.cc:2454] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:26.959547 8352 raft_consensus.cc:2454] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:26.964432 8636 tablet_bootstrap.cc:492] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:26.964900 8636 ts_tablet_manager.cc:1397] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.092s user 0.008s sys 0.020s
I20260812 19:27:26.965804 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "311b68f298164090bc9458e3ee16f6cb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:26.966355 8178 raft_consensus.cc:3037] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.967446 8636 raft_consensus.cc:348] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.968067 8636 raft_consensus.cc:374] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.968330 8636 raft_consensus.cc:729] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.968890 8636 consensus_queue.cc:260] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.970932 8636 ts_tablet_manager.cc:1428] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s
I20260812 19:27:26.971712 8636 tablet_bootstrap.cc:492] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:26.974188 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "622deb66eead473189ab85a53cb8c81f" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:26.974743 8176 raft_consensus.cc:3037] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:26.975847 8170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a53a91dc9e41d58ee4f6a083ca204c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:26.978394 8446 leader_election.cc:341] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:26.978945 8446 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:26.986677 10341 consensus_queue.cc:1035] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:26.988844 8636 tablet_bootstrap.cc:654] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:26.924749 8627 raft_consensus.cc:348] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.991797 8627 raft_consensus.cc:374] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:26.992218 8627 raft_consensus.cc:729] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:26.992901 8627 consensus_queue.cc:260] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:26.994305 8627 ts_tablet_manager.cc:1428] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.073s user 0.005s sys 0.000s
I20260812 19:27:26.999336 8623 tablet_bootstrap.cc:492] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:27.000869 8636 tablet_bootstrap.cc:492] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:27.001297 8636 ts_tablet_manager.cc:1397] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.030s user 0.014s sys 0.002s
I20260812 19:27:27.003808 8636 raft_consensus.cc:348] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.004447 8636 raft_consensus.cc:374] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.004722 8623 tablet_bootstrap.cc:654] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.004855 8636 raft_consensus.cc:729] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.005493 8636 consensus_queue.cc:260] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.007511 8178 raft_consensus.cc:2454] T 311b68f298164090bc9458e3ee16f6cb P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:27.008016 8636 ts_tablet_manager.cc:1428] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 19:27:27.008769 8446 leader_election.cc:302] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:27.009573 10187 raft_consensus.cc:2781] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:27.009975 10187 raft_consensus.cc:686] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:27.010712 10187 consensus_queue.cc:237] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.014165 8176 raft_consensus.cc:2454] T 622deb66eead473189ab85a53cb8c81f P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
W20260812 19:27:27.015372 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 64118.4us
I20260812 19:27:27.015899 8446 leader_election.cc:302] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
W20260812 19:27:27.017273 8443 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:27.017643 8443 leader_election.cc:302] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:27.018893 8443 consensus_peers.cc:487] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Couldn't send request to peer 93aafc5b36824666a82aa55bc73df9e7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:27:27.020830 10340 raft_consensus.cc:2726] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:27.021731 10340 consensus_queue.cc:1035] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:27.027371 10322 raft_consensus.cc:2781] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:27.027781 10322 raft_consensus.cc:686] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:27.028273 8623 tablet_bootstrap.cc:492] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:27.028647 8623 ts_tablet_manager.cc:1397] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.000s
I20260812 19:27:27.028937 10322 consensus_queue.cc:237] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.031283 8623 raft_consensus.cc:348] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.031935 8623 raft_consensus.cc:374] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.034092 8443 leader_election.cc:302] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:27.034794 10341 raft_consensus.cc:2781] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:27.035234 10341 raft_consensus.cc:686] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:27.035986 10341 consensus_queue.cc:237] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.032193 8623 raft_consensus.cc:729] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.047973 8623 consensus_queue.cc:260] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.049767 8623 ts_tablet_manager.cc:1428] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20260812 19:27:27.050655 8623 tablet_bootstrap.cc:492] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:27.059466 8627 tablet_bootstrap.cc:492] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:27.088058 8636 tablet_bootstrap.cc:492] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:27.128319 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 79907.3us
I20260812 19:27:27.138748 10348 raft_consensus.cc:482] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:27.139621 10348 raft_consensus.cc:504] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.143716 10348 leader_election.cc:288] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.139170 8627 tablet_bootstrap.cc:654] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.154026 10334 raft_consensus.cc:482] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:27.154678 10334 raft_consensus.cc:504] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.160516 10334 leader_election.cc:288] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.162954 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67135f8c5ae422485bca11ada90afaa" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:27.166613 8281 leader_election.cc:341] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:27.194049 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51a28468ba74a8e88d0936dc3281eca" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:27.194590 8516 raft_consensus.cc:2454] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:27.192243 10322 consensus_queue.cc:1035] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:27.220096 8278 leader_election.cc:302] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:27.221168 10360 raft_consensus.cc:2781] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:27.221486 10360 raft_consensus.cc:482] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:27.221771 10360 raft_consensus.cc:3037] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.224812 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67135f8c5ae422485bca11ada90afaa" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:27.225677 8509 raft_consensus.cc:2454] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:27.229279 10360 raft_consensus.cc:504] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.231199 10360 leader_election.cc:288] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.234493 8278 leader_election.cc:302] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:27.235347 10360 raft_consensus.cc:2781] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:27.235688 10360 raft_consensus.cc:482] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:27.236066 10360 raft_consensus.cc:3037] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.243398 10360 raft_consensus.cc:504] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.245605 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51a28468ba74a8e88d0936dc3281eca" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:27.246536 8509 raft_consensus.cc:3037] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.248162 10360 leader_election.cc:288] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.254719 8636 tablet_bootstrap.cc:654] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.261925 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67135f8c5ae422485bca11ada90afaa" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:27.262455 8510 raft_consensus.cc:3037] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.179531 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51a28468ba74a8e88d0936dc3281eca" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:27.269927 8177 raft_consensus.cc:2454] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:27.270692 8510 raft_consensus.cc:2454] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
W20260812 19:27:27.270798 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 98159.1us
I20260812 19:27:27.277998 8278 leader_election.cc:302] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:27.279268 10360 raft_consensus.cc:2781] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:27.279757 10360 raft_consensus.cc:686] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:27.280875 10360 consensus_queue.cc:237] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.283929 8627 tablet_bootstrap.cc:492] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:27.284366 8627 ts_tablet_manager.cc:1397] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.225s user 0.010s sys 0.004s
I20260812 19:27:27.286937 8627 raft_consensus.cc:348] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.287580 8627 raft_consensus.cc:374] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.287874 8627 raft_consensus.cc:729] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.287778 8169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c67135f8c5ae422485bca11ada90afaa" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:27.289173 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51a28468ba74a8e88d0936dc3281eca" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:27.289695 8178 raft_consensus.cc:3037] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:27.306100 8281 consensus_peers.cc:487] T 7e087bad986b423098a68fa5d05ff17a P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e087bad986b423098a68fa5d05ff17a. This is attempt 6: this message will repeat every 5th retry.
W20260812 19:27:27.307035 8281 leader_election.cc:341] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:27.308605 10187 consensus_queue.cc:1035] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:27.309043 8178 raft_consensus.cc:2454] T b51a28468ba74a8e88d0936dc3281eca P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:27.312901 10340 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:27.321511 8281 leader_election.cc:302] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:27.313603 10340 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:27.324214 10357 raft_consensus.cc:2781] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:27.324676 10357 raft_consensus.cc:686] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:27.325436 10357 consensus_queue.cc:237] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.326390 10340 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:27.332906 8446 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:27.342410 8509 raft_consensus.cc:2454] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:27.353816 8623 tablet_bootstrap.cc:654] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:27.374323 8443 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:27.374758 8443 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:27.376114 10323 raft_consensus.cc:2726] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:27.376993 8627 consensus_queue.cc:260] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.389739 8636 tablet_bootstrap.cc:492] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:27.398381 8627 ts_tablet_manager.cc:1428] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.114s user 0.005s sys 0.000s
I20260812 19:27:27.399519 8636 ts_tablet_manager.cc:1397] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.312s user 0.006s sys 0.013s
I20260812 19:27:27.400111 8627 tablet_bootstrap.cc:492] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:27.417109 8623 tablet_bootstrap.cc:492] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:27.420501 8623 ts_tablet_manager.cc:1397] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.370s user 0.009s sys 0.005s
I20260812 19:27:27.437179 8636 raft_consensus.cc:348] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.457554 8636 raft_consensus.cc:374] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.457928 8636 raft_consensus.cc:729] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.458567 8636 consensus_queue.cc:260] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.470109 10187 consensus_queue.cc:1035] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:27.471889 10187 consensus_queue.cc:1035] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260812 19:27:27.422674 8623 raft_consensus.cc:348] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.479434 8623 raft_consensus.cc:374] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.480293 8623 raft_consensus.cc:729] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.502345 8623 consensus_queue.cc:260] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.507529 8623 ts_tablet_manager.cc:1428] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.087s user 0.005s sys 0.000s
I20260812 19:27:27.529146 8636 ts_tablet_manager.cc:1428] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.126s user 0.003s sys 0.002s
I20260812 19:27:27.541137 8636 tablet_bootstrap.cc:492] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:27.542510 10340 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:27.542965 10340 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:27.546697 10340 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:27.556468 8446 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:27.562999 8623 tablet_bootstrap.cc:492] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:27.570704 10341 consensus_queue.cc:1035] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:27.577365 8443 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:27.577819 8443 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:27.578850 10341 raft_consensus.cc:2726] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:27.583707 8636 tablet_bootstrap.cc:654] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.589178 10341 raft_consensus.cc:482] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:27.589265 8627 tablet_bootstrap.cc:700] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7: Time spent opening tablet: real 0.125s user 0.002s sys 0.002s
I20260812 19:27:27.589954 8627 tablet_bootstrap.cc:654] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.589638 10341 raft_consensus.cc:504] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.591480 10341 leader_election.cc:288] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.593341 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:27.594882 8446 leader_election.cc:341] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:27.605671 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:27.611053 8344 raft_consensus.cc:2454] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:27.616698 8443 leader_election.cc:302] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:27.617406 10341 raft_consensus.cc:2781] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:27.617789 10341 raft_consensus.cc:482] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:27.618176 10341 raft_consensus.cc:3037] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.639624 10341 raft_consensus.cc:504] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.644838 8623 tablet_bootstrap.cc:654] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.669548 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:27.670889 8446 leader_election.cc:341] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:27.684439 10341 leader_election.cc:288] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.685864 10138 raft_consensus.cc:482] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:27.686349 10138 raft_consensus.cc:504] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.688169 10138 leader_election.cc:288] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.690073 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "663d0d16b9cd4bed9bb5529b514f9e30" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:27.691723 8446 leader_election.cc:341] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:27.692929 8636 tablet_bootstrap.cc:492] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:27.693321 8636 ts_tablet_manager.cc:1397] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.152s user 0.017s sys 0.009s
I20260812 19:27:27.697935 8636 raft_consensus.cc:348] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.698565 8636 raft_consensus.cc:374] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.698820 8636 raft_consensus.cc:729] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.701710 8636 consensus_queue.cc:260] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.704897 8636 ts_tablet_manager.cc:1428] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20260812 19:27:27.709071 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "663d0d16b9cd4bed9bb5529b514f9e30" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:27.709611 8356 raft_consensus.cc:2454] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:27.712234 8623 tablet_bootstrap.cc:492] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:27.712814 8623 ts_tablet_manager.cc:1397] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.153s user 0.009s sys 0.000s
I20260812 19:27:27.714316 8443 leader_election.cc:302] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:27.716548 10138 raft_consensus.cc:2781] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:27.716889 10138 raft_consensus.cc:482] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:27.717202 10138 raft_consensus.cc:3037] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.715067 8623 raft_consensus.cc:348] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.717626 8623 raft_consensus.cc:374] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.717878 8623 raft_consensus.cc:729] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.720618 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:27.721200 8347 raft_consensus.cc:3037] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.728983 10192 raft_consensus.cc:482] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:27.729561 10192 raft_consensus.cc:504] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.729161 8623 consensus_queue.cc:260] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.737941 8623 ts_tablet_manager.cc:1428] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.025s user 0.005s sys 0.000s
I20260812 19:27:27.739328 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5e92063f494c79be75371f2626b1e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:27.740348 8507 raft_consensus.cc:2454] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:27.741739 8107 leader_election.cc:302] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:27.742110 8627 tablet_bootstrap.cc:492] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:27.742551 8627 ts_tablet_manager.cc:1397] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.343s user 0.004s sys 0.009s
I20260812 19:27:27.744504 10286 raft_consensus.cc:2781] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:27.745014 10286 raft_consensus.cc:482] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:27.745491 10286 raft_consensus.cc:3037] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.746860 8627 raft_consensus.cc:348] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.747517 8627 raft_consensus.cc:374] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.747785 8627 raft_consensus.cc:729] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.753266 10192 leader_election.cc:288] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:27.754854 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5e92063f494c79be75371f2626b1e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:27.755615 8352 raft_consensus.cc:2454] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 0.
I20260812 19:27:27.755857 8623 tablet_bootstrap.cc:492] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:27.764860 8347 raft_consensus.cc:2454] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:27.766436 8443 leader_election.cc:302] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:27.767562 10341 raft_consensus.cc:2781] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:27.768903 10341 raft_consensus.cc:686] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:27.772897 10341 consensus_queue.cc:237] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.785830 10138 raft_consensus.cc:504] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.790678 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "663d0d16b9cd4bed9bb5529b514f9e30" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:27.791409 8347 raft_consensus.cc:3037] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:27.825233 8627 consensus_queue.cc:260] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.827452 8623 tablet_bootstrap.cc:654] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.828248 8636 tablet_bootstrap.cc:492] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:27.857386 8636 tablet_bootstrap.cc:654] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:27.863835 10138 leader_election.cc:288] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:27.863502 8169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "663d0d16b9cd4bed9bb5529b514f9e30" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:27.865839 8446 leader_election.cc:341] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:27.872803 8627 ts_tablet_manager.cc:1428] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.130s user 0.008s sys 0.002s
I20260812 19:27:27.873850 8627 tablet_bootstrap.cc:492] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:27.905201 10341 consensus_queue.cc:1035] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:27.927277 8347 raft_consensus.cc:2454] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:27.973052 8636 tablet_bootstrap.cc:492] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:27.972971 8443 leader_election.cc:302] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:27.973471 8636 ts_tablet_manager.cc:1397] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.145s user 0.007s sys 0.018s
I20260812 19:27:27.974218 10341 raft_consensus.cc:2781] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:27.974934 10341 raft_consensus.cc:686] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:27.976859 10341 consensus_queue.cc:237] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.977198 8636 raft_consensus.cc:348] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:27.979970 8636 raft_consensus.cc:374] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:27.980213 8636 raft_consensus.cc:729] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:27.995870 8636 consensus_queue.cc:260] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.001427 8636 ts_tablet_manager.cc:1428] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.028s user 0.008s sys 0.000s
I20260812 19:27:27.974448 10286 raft_consensus.cc:504] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.007128 10286 leader_election.cc:288] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:28.008419 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5e92063f494c79be75371f2626b1e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:28.009008 8510 raft_consensus.cc:3037] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.024806 8510 raft_consensus.cc:2454] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:28.026132 8107 leader_election.cc:302] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:28.027010 10249 raft_consensus.cc:2781] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:28.028213 10249 raft_consensus.cc:686] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Becoming Leader. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Running, Role: LEADER
I20260812 19:27:28.029959 10249 consensus_queue.cc:237] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.040293 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b5e92063f494c79be75371f2626b1e3" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:28.041092 8344 raft_consensus.cc:3037] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.051241 10187 consensus_queue.cc:1035] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:28.055225 10187 raft_consensus.cc:482] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:28.055819 10187 raft_consensus.cc:504] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.060880 10187 leader_election.cc:288] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:28.060951 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fac74fcb73d1489f8542496293d6141c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:28.062461 8446 leader_election.cc:341] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:28.069427 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fac74fcb73d1489f8542496293d6141c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:28.070088 8356 raft_consensus.cc:2454] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:28.070997 8443 leader_election.cc:302] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:28.072036 10187 raft_consensus.cc:2781] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:28.072540 10187 raft_consensus.cc:482] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:28.073076 10187 raft_consensus.cc:3037] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.078089 8636 tablet_bootstrap.cc:492] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:28.086310 8344 raft_consensus.cc:2454] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6a95b50ceede4dc99913aec28ddaa380 in term 1.
I20260812 19:27:28.090325 8627 tablet_bootstrap.cc:654] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:28.095674 8623 tablet_bootstrap.cc:492] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:28.096103 10322 raft_consensus.cc:482] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:28.096792 10322 raft_consensus.cc:504] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.100401 8623 ts_tablet_manager.cc:1397] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.345s user 0.008s sys 0.014s
I20260812 19:27:28.107838 10322 leader_election.cc:288] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:28.110380 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:28.112428 10360 raft_consensus.cc:482] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:28.113018 10360 raft_consensus.cc:504] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.117961 8636 tablet_bootstrap.cc:654] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:28.118336 10360 leader_election.cc:288] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:28.111838 8177 raft_consensus.cc:2454] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
W20260812 19:27:28.121066 8446 consensus_peers.cc:487] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:28.122058 8446 leader_election.cc:302] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:28.122987 10322 raft_consensus.cc:2781] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:28.123312 10322 raft_consensus.cc:482] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:28.123605 10322 raft_consensus.cc:3037] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.140269 8623 raft_consensus.cc:348] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.141090 8623 raft_consensus.cc:374] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:28.141395 8623 raft_consensus.cc:729] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:28.148021 10187 raft_consensus.cc:504] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.156005 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:28.157068 8177 raft_consensus.cc:2454] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:28.155467 8623 consensus_queue.cc:260] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.158209 8281 leader_election.cc:302] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:28.159200 10334 raft_consensus.cc:2781] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:28.159686 10334 raft_consensus.cc:482] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:28.160104 10334 raft_consensus.cc:3037] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.161324 8623 ts_tablet_manager.cc:1428] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.061s user 0.006s sys 0.001s
I20260812 19:27:28.162313 8623 tablet_bootstrap.cc:492] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:28.172979 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fac74fcb73d1489f8542496293d6141c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:28.173743 8177 raft_consensus.cc:3037] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.211544 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:28.213168 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fac74fcb73d1489f8542496293d6141c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:28.214736 8352 raft_consensus.cc:3037] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.223745 8352 raft_consensus.cc:2454] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:28.241530 10334 raft_consensus.cc:504] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.243530 8344 raft_consensus.cc:2379] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:28.249023 8623 tablet_bootstrap.cc:654] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:28.249606 8281 consensus_peers.cc:487] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:28.252615 10391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:28.253650 10391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:28.257668 10360 consensus_queue.cc:1035] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:28.264008 10334 leader_election.cc:288] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:28.267297 7947 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet df369d3c4e004c29ac65c5ecf7f8c4cc (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6], current schema version=2) failed: Not found: failed to reset TS proxy: No leader found: Tablet df369d3c4e004c29ac65c5ecf7f8c4cc consensus state has no leader
I20260812 19:27:28.271311 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:28.232105 8177 raft_consensus.cc:2454] T fac74fcb73d1489f8542496293d6141c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:28.273762 8627 tablet_bootstrap.cc:492] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:28.274204 8627 ts_tablet_manager.cc:1397] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.401s user 0.012s sys 0.004s
I20260812 19:27:28.274745 10391 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:28.292646 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:28.293282 8177 raft_consensus.cc:3037] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:28.346112 8623 tablet_bootstrap.cc:492] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:28.346601 8623 ts_tablet_manager.cc:1397] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.185s user 0.008s sys 0.024s
I20260812 19:27:28.350729 8623 raft_consensus.cc:348] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.351392 8623 raft_consensus.cc:374] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:28.351629 8623 raft_consensus.cc:729] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:28.352240 8623 consensus_queue.cc:260] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.423930 8623 ts_tablet_manager.cc:1428] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.077s user 0.006s sys 0.004s
I20260812 19:27:28.169989 10187 leader_election.cc:288] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:28.207931 10323 consensus_queue.cc:1035] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.272s
I20260812 19:27:28.223845 8636 tablet_bootstrap.cc:492] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:28.148226 10322 raft_consensus.cc:504] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.481329 8636 ts_tablet_manager.cc:1397] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.403s user 0.012s sys 0.013s
I20260812 19:27:28.253186 8443 leader_election.cc:302] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:27:28.486729 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 233627us
W20260812 19:27:28.490240 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 217045us
I20260812 19:27:28.149971 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:28.492888 8516 raft_consensus.cc:2379] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:28.221174 10340 consensus_queue.cc:1035] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.273s
I20260812 19:27:28.494825 8177 raft_consensus.cc:2454] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:28.495990 10340 raft_consensus.cc:2781] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:28.508028 10340 raft_consensus.cc:686] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:28.511061 10340 consensus_queue.cc:237] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.485459 8636 raft_consensus.cc:348] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.518301 8636 raft_consensus.cc:374] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:28.518682 8636 raft_consensus.cc:729] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:28.519568 8636 consensus_queue.cc:260] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.526964 8636 ts_tablet_manager.cc:1428] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.045s user 0.004s sys 0.004s
I20260812 19:27:28.532220 8623 tablet_bootstrap.cc:492] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:28.553260 8636 tablet_bootstrap.cc:492] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:28.558415 10323 consensus_queue.cc:1035] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:28.432085 8627 raft_consensus.cc:348] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:28.606050 8627 raft_consensus.cc:374] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:28.606379 8627 raft_consensus.cc:729] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:28.607092 8636 tablet_bootstrap.cc:654] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:28.607055 8627 consensus_queue.cc:260] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:28.610657 8627 ts_tablet_manager.cc:1428] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.336s user 0.007s sys 0.001s
I20260812 19:27:28.611817 8627 tablet_bootstrap.cc:492] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:28.615123 10322 leader_election.cc:288] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:28.622927 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:28.623795 8510 raft_consensus.cc:2379] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:28.669457 8281 leader_election.cc:302] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:28.670383 10334 raft_consensus.cc:2781] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:28.671115 10334 raft_consensus.cc:686] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:28.672654 10334 consensus_queue.cc:237] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.671124 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:28.717900 8636 tablet_bootstrap.cc:492] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:28.718442 8636 ts_tablet_manager.cc:1397] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.165s user 0.012s sys 0.012s
I20260812 19:27:28.726379 8636 raft_consensus.cc:348] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:28.738442 8636 raft_consensus.cc:374] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:28.738788 8636 raft_consensus.cc:729] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:28.739511 8636 consensus_queue.cc:260] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:28.747113 8636 ts_tablet_manager.cc:1428] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.028s user 0.004s sys 0.004s
I20260812 19:27:28.753659 8636 tablet_bootstrap.cc:492] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:28.736769 10249 raft_consensus.cc:482] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:28.777838 10249 raft_consensus.cc:504] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.786005 8627 tablet_bootstrap.cc:654] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:28.790484 8623 tablet_bootstrap.cc:654] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:28.796749 10334 consensus_queue.cc:1035] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:28.804453 8636 tablet_bootstrap.cc:654] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:28.807739 10249 leader_election.cc:288] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:28.811517 10357 consensus_queue.cc:1035] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:28.844401 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 71491us
I20260812 19:27:28.850469 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:28.851230 10192 raft_consensus.cc:482] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:28.851730 10192 raft_consensus.cc:504] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:28.853778 10192 leader_election.cc:288] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:28.859824 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a53a91dc9e41d58ee4f6a083ca204c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
W20260812 19:27:28.905006 9360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.630s (SENT) [suppressed 2 similar messages]
I20260812 19:27:28.909008 8623 tablet_bootstrap.cc:492] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:28.909641 8623 ts_tablet_manager.cc:1397] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.440s user 0.018s sys 0.001s
W20260812 19:27:28.910395 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 113070us
I20260812 19:27:28.958950 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c607886a76344185aa9af5da797b9ae8" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:28.959789 8178 raft_consensus.cc:2379] T c607886a76344185aa9af5da797b9ae8 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:29.017023 10414 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:29.024374 8627 tablet_bootstrap.cc:492] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:29.024997 8627 ts_tablet_manager.cc:1397] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.413s user 0.013s sys 0.000s
I20260812 19:27:29.027570 8627 raft_consensus.cc:348] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:29.017659 10414 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:29.058885 8172 raft_consensus.cc:3037] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:29.079061 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:29.080015 10414 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:29.085338 8623 raft_consensus.cc:348] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.086148 8623 raft_consensus.cc:374] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.086460 8623 raft_consensus.cc:729] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:29.087064 8623 consensus_queue.cc:260] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.045444 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "841c459584534458977b6182b71c77f1" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:29.118712 8344 raft_consensus.cc:2379] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:29.122814 8627 raft_consensus.cc:374] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.123237 8627 raft_consensus.cc:729] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:29.123971 8627 consensus_queue.cc:260] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:29.126892 8627 ts_tablet_manager.cc:1428] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.102s user 0.005s sys 0.000s
I20260812 19:27:29.127660 8446 leader_election.cc:302] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:29.128794 10394 raft_consensus.cc:2726] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:29.156803 8636 tablet_bootstrap.cc:492] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:29.157215 8636 ts_tablet_manager.cc:1397] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.404s user 0.070s sys 0.069s
I20260812 19:27:29.159389 8636 raft_consensus.cc:348] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.160033 8636 raft_consensus.cc:374] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.160290 8636 raft_consensus.cc:729] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:29.160844 8636 consensus_queue.cc:260] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.162164 8636 ts_tablet_manager.cc:1428] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260812 19:27:29.162992 8636 tablet_bootstrap.cc:492] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:29.171593 10394 consensus_queue.cc:1035] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:29.178704 8636 tablet_bootstrap.cc:654] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:29.213271 8627 tablet_bootstrap.cc:492] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:29.219848 8627 tablet_bootstrap.cc:654] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:29.248680 10340 consensus_queue.cc:1035] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:29.266078 10340 consensus_queue.cc:1035] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:29.275549 10340 raft_consensus.cc:482] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:29.276490 10340 raft_consensus.cc:504] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.280773 10340 leader_election.cc:288] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:29.230041 10357 raft_consensus.cc:482] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:29.304740 10357 raft_consensus.cc:504] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:29.310209 10357 leader_election.cc:288] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:29.320155 10394 raft_consensus.cc:482] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:29.321015 10394 raft_consensus.cc:504] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:29.325426 10394 leader_election.cc:288] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:29.328780 8636 tablet_bootstrap.cc:492] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:29.329239 8636 ts_tablet_manager.cc:1397] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.166s user 0.022s sys 0.023s
I20260812 19:27:29.330657 8623 ts_tablet_manager.cc:1428] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.421s user 0.006s sys 0.004s
I20260812 19:27:29.333262 8636 raft_consensus.cc:348] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:29.334031 8636 raft_consensus.cc:374] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.334292 8636 raft_consensus.cc:729] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:29.334892 8636 consensus_queue.cc:260] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:29.356216 8623 tablet_bootstrap.cc:492] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:29.360729 8636 ts_tablet_manager.cc:1428] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.031s user 0.005s sys 0.004s
I20260812 19:27:29.361907 8636 tablet_bootstrap.cc:492] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:29.365382 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b32b8e857c04567a2a751c379a05440" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:29.388139 8344 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e0a53a91dc9e41d58ee4f6a083ca204c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:29.392982 10394 raft_consensus.cc:482] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:29.393926 10394 raft_consensus.cc:504] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:29.398367 10394 leader_election.cc:288] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:29.403030 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 52816.2us
I20260812 19:27:29.412093 8108 leader_election.cc:302] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:29.412955 10407 raft_consensus.cc:2726] T 841c459584534458977b6182b71c77f1 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:29.433244 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 64058us
I20260812 19:27:29.442035 8636 tablet_bootstrap.cc:654] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:29.464371 8281 leader_election.cc:341] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:29.464660 8636 tablet_bootstrap.cc:492] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:29.465138 8636 ts_tablet_manager.cc:1397] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.103s user 0.002s sys 0.012s
I20260812 19:27:29.469779 8636 raft_consensus.cc:348] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.472638 8636 raft_consensus.cc:374] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.472874 8636 raft_consensus.cc:729] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:29.478690 8636 consensus_queue.cc:260] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.488466 8507 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b32b8e857c04567a2a751c379a05440" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:29.489104 8507 raft_consensus.cc:2454] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:29.493994 8178 raft_consensus.cc:3037] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:29.498956 8636 ts_tablet_manager.cc:1428] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.034s user 0.005s sys 0.000s
I20260812 19:27:29.519527 8636 tablet_bootstrap.cc:492] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:29.524504 8636 tablet_bootstrap.cc:654] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:29.529244 8180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:29.546054 8627 tablet_bootstrap.cc:492] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:29.546507 8627 ts_tablet_manager.cc:1397] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.335s user 0.007s sys 0.006s
I20260812 19:27:29.547266 8636 tablet_bootstrap.cc:492] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:29.547652 8636 ts_tablet_manager.cc:1397] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.000s
I20260812 19:27:29.549904 8636 raft_consensus.cc:348] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.550549 8636 raft_consensus.cc:374] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.550792 8636 raft_consensus.cc:729] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:29.553923 8636 consensus_queue.cc:260] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.557693 8636 ts_tablet_manager.cc:1428] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.010s user 0.001s sys 0.004s
W20260812 19:27:29.566561 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.630s (SENT)
I20260812 19:27:29.567057 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:29.573686 8627 raft_consensus.cc:348] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.574455 8627 raft_consensus.cc:374] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.574736 8627 raft_consensus.cc:729] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
W20260812 19:27:29.625468 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 58966us
I20260812 19:27:29.619830 10434 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:27:29.668457 8623 tablet_bootstrap.cc:654] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:29.672379 8278 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 84906.1us
W20260812 19:27:29.683727 7781 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.598s (SENT) [suppressed 1 similar messages]
I20260812 19:27:29.688917 8627 consensus_queue.cc:260] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.691656 8627 ts_tablet_manager.cc:1428] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.145s user 0.006s sys 0.001s
I20260812 19:27:29.721897 10394 raft_consensus.cc:482] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:29.725598 10394 raft_consensus.cc:504] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:29.734836 8627 tablet_bootstrap.cc:492] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:29.736047 10394 leader_election.cc:288] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:29.742309 8636 tablet_bootstrap.cc:492] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:29.755893 8636 tablet_bootstrap.cc:654] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:29.756600 10340 raft_consensus.cc:482] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:29.757325 10340 raft_consensus.cc:504] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.764072 10340 leader_election.cc:288] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:29.779824 10340 raft_consensus.cc:482] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:29.780825 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:29.780634 10340 raft_consensus.cc:504] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.787588 10340 leader_election.cc:288] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:29.797591 8446 consensus_peers.cc:487] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:29.802959 8446 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
W20260812 19:27:29.803894 8446 leader_election.cc:341] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:29.821866 8636 tablet_bootstrap.cc:492] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
W20260812 19:27:29.828938 8446 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 544d3d74baa6477da11abbee139ee66f
I20260812 19:27:29.829504 10322 consensus_queue.cc:1035] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:29.831887 8636 ts_tablet_manager.cc:1397] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.090s user 0.015s sys 0.011s
I20260812 19:27:29.805590 10426 consensus_queue.cc:1035] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260812 19:27:29.802397 8108 leader_election.cc:302] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:29.840468 8636 raft_consensus.cc:348] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.836179 10426 raft_consensus.cc:2726] T e0a53a91dc9e41d58ee4f6a083ca204c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:29.841851 8636 raft_consensus.cc:374] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.845502 8636 raft_consensus.cc:729] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:29.848536 8636 consensus_queue.cc:260] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:29.853459 8636 ts_tablet_manager.cc:1428] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20260812 19:27:29.856897 8636 tablet_bootstrap.cc:492] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:29.851215 10334 raft_consensus.cc:482] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:29.872902 10334 raft_consensus.cc:504] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:29.877862 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:29.879280 8178 raft_consensus.cc:3037] T c67135f8c5ae422485bca11ada90afaa P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:29.883103 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140266bae6254efe9b87d0f8e3bfaa4e" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:29.885077 8281 leader_election.cc:341] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:29.884151 8351 raft_consensus.cc:2454] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:29.886595 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:29.887681 8349 raft_consensus.cc:2454] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:29.889840 8345 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:29.898181 10334 leader_election.cc:288] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
W20260812 19:27:29.851300 10439 log.cc:924] Time spent T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.061s user 0.000s sys 0.001s
I20260812 19:27:29.897868 10357 consensus_queue.cc:1035] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:29.918850 8636 tablet_bootstrap.cc:654] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:29.922451 8443 leader_election.cc:341] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:29.922967 8443 leader_election.cc:302] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:29.924063 8443 leader_election.cc:341] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 544d3d74baa6477da11abbee139ee66f
I20260812 19:27:29.927857 8443 leader_election.cc:302] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:29.928960 8443 leader_election.cc:341] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: a49e46c8ba704680bf12423854883b55
I20260812 19:27:29.929361 8443 leader_election.cc:302] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:29.930049 10322 raft_consensus.cc:2726] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:29.932127 10322 raft_consensus.cc:2726] T 544d3d74baa6477da11abbee139ee66f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:29.932590 10394 raft_consensus.cc:2726] T a49e46c8ba704680bf12423854883b55 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:29.939574 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:29.940580 8508 raft_consensus.cc:2454] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:29.977519 8627 tablet_bootstrap.cc:654] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:29.981967 8636 tablet_bootstrap.cc:492] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:29.982707 8636 ts_tablet_manager.cc:1397] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.126s user 0.012s sys 0.008s
I20260812 19:27:29.986137 8636 raft_consensus.cc:348] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:29.997216 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 68269us
I20260812 19:27:29.998075 8636 raft_consensus.cc:374] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:29.997753 8623 tablet_bootstrap.cc:492] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:29.998695 8636 raft_consensus.cc:729] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:30.000559 8623 ts_tablet_manager.cc:1397] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.649s user 0.003s sys 0.019s
I20260812 19:27:30.000314 10322 consensus_queue.cc:1035] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:30.001381 8636 consensus_queue.cc:260] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.004763 8278 leader_election.cc:302] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:30.006572 10357 raft_consensus.cc:2781] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:30.007144 10357 raft_consensus.cc:482] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:30.007757 10357 raft_consensus.cc:3037] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:30.011370 8443 leader_election.cc:302] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:30.012606 10340 raft_consensus.cc:2781] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:30.013147 10340 raft_consensus.cc:482] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:30.013738 10340 raft_consensus.cc:3037] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:30.015486 8636 ts_tablet_manager.cc:1428] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.032s user 0.006s sys 0.001s
I20260812 19:27:30.024744 8443 leader_election.cc:302] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:27:30.026165 8443 leader_election.cc:341] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.027209 10442 raft_consensus.cc:2781] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:30.028292 10442 raft_consensus.cc:482] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:30.030618 10442 raft_consensus.cc:3037] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:30.053493 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 157857us
I20260812 19:27:30.128392 8636 tablet_bootstrap.cc:492] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:30.137696 8636 tablet_bootstrap.cc:654] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:30.152281 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 140115us
I20260812 19:27:30.167023 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:30.168591 10394 raft_consensus.cc:482] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:30.169190 10394 raft_consensus.cc:504] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.169972 8623 raft_consensus.cc:348] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.170735 8623 raft_consensus.cc:374] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:30.171015 8623 raft_consensus.cc:729] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:30.175112 10394 leader_election.cc:288] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:30.180426 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 112796us
I20260812 19:27:30.239059 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140266bae6254efe9b87d0f8e3bfaa4e" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:30.240783 10455 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:30.242115 10455 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:30.246762 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:30.250304 10455 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:30.257354 8623 consensus_queue.cc:260] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.261653 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:30.279479 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 126533us
W20260812 19:27:30.299464 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.598s (SENT)
W20260812 19:27:30.299446 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 269926us
I20260812 19:27:30.300019 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:30.298918 10357 raft_consensus.cc:504] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:30.191694 10340 raft_consensus.cc:504] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.348886 10340 leader_election.cc:288] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:30.345718 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 64543.7us
I20260812 19:27:30.363047 10357 leader_election.cc:288] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
W20260812 19:27:30.367799 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 73706.4us
I20260812 19:27:30.377765 10468 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:27:30.379016 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 79591.5us
I20260812 19:27:30.379622 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b32b8e857c04567a2a751c379a05440" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:30.260129 8623 ts_tablet_manager.cc:1428] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.259s user 0.005s sys 0.003s
I20260812 19:27:30.390095 8180 raft_consensus.cc:3037] T 663d0d16b9cd4bed9bb5529b514f9e30 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:30.415053 10442 raft_consensus.cc:504] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:30.372437 8278 leader_election.cc:302] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:27:30.420821 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 50072.5us
I20260812 19:27:30.421852 10461 raft_consensus.cc:2781] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:30.422305 10461 raft_consensus.cc:482] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:30.422765 10461 raft_consensus.cc:3037] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:27:30.382688 8281 leader_election.cc:341] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.403131 8627 tablet_bootstrap.cc:492] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:30.426687 8627 ts_tablet_manager.cc:1397] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.692s user 0.000s sys 0.021s
I20260812 19:27:30.440768 8623 tablet_bootstrap.cc:492] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:30.440830 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbff8d38116d4af9ba9497f65e876827" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:30.460361 10442 leader_election.cc:288] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:30.419299 8636 tablet_bootstrap.cc:492] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:30.461321 8636 ts_tablet_manager.cc:1397] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.333s user 0.006s sys 0.011s
I20260812 19:27:30.470283 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140266bae6254efe9b87d0f8e3bfaa4e" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:30.500663 8636 raft_consensus.cc:348] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.502076 8636 raft_consensus.cc:374] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:30.506716 8636 raft_consensus.cc:729] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:30.512667 8636 consensus_queue.cc:260] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.516523 8636 ts_tablet_manager.cc:1428] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.055s user 0.005s sys 0.002s
I20260812 19:27:30.533193 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b32b8e857c04567a2a751c379a05440" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:30.535790 8511 raft_consensus.cc:3037] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:30.524032 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]
I20260812 19:27:30.541944 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]
I20260812 19:27:30.544672 8636 tablet_bootstrap.cc:492] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:30.547750 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3]
I20260812 19:27:30.558429 8511 raft_consensus.cc:2454] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:30.559417 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]
I20260812 19:27:30.563140 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825]
I20260812 19:27:30.572961 10442 raft_consensus.cc:482] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:30.573671 10442 raft_consensus.cc:504] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.576362 10442 leader_election.cc:288] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:30.576004 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6]
I20260812 19:27:30.597551 8627 raft_consensus.cc:348] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.598269 8627 raft_consensus.cc:374] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:30.598498 8627 raft_consensus.cc:729] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:30.599084 8636 tablet_bootstrap.cc:654] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:30.599007 8627 consensus_queue.cc:260] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.611172 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050]
W20260812 19:27:30.623245 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 192427us
I20260812 19:27:30.649899 10461 raft_consensus.cc:504] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:30.651695 8627 ts_tablet_manager.cc:1428] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.225s user 0.003s sys 0.003s
I20260812 19:27:30.653456 8627 tablet_bootstrap.cc:492] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:30.673754 8627 tablet_bootstrap.cc:654] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:30.677165 10461 leader_election.cc:288] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:30.678805 8636 tablet_bootstrap.cc:492] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:30.679231 8636 ts_tablet_manager.cc:1397] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.135s user 0.011s sys 0.000s
I20260812 19:27:30.682027 8636 raft_consensus.cc:348] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.682960 8636 raft_consensus.cc:374] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:30.683231 8636 raft_consensus.cc:729] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:30.683945 8636 consensus_queue.cc:260] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.687151 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]
I20260812 19:27:30.692664 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685]
I20260812 19:27:30.707614 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbff8d38116d4af9ba9497f65e876827" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:30.708196 8356 raft_consensus.cc:2454] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:30.725603 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07]
I20260812 19:27:30.738698 10322 raft_consensus.cc:482] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:30.739295 10322 raft_consensus.cc:504] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.740183 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140266bae6254efe9b87d0f8e3bfaa4e" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:30.740722 8352 raft_consensus.cc:3037] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:30.742522 10322 leader_election.cc:288] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:30.746503 8352 raft_consensus.cc:2454] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
W20260812 19:27:30.747942 8446 leader_election.cc:341] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.749177 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b]
I20260812 19:27:30.754429 8636 ts_tablet_manager.cc:1428] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.075s user 0.006s sys 0.000s
I20260812 19:27:30.755578 8636 tablet_bootstrap.cc:492] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:30.757609 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:30.758383 8350 raft_consensus.cc:2379] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:30.763239 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb]
W20260812 19:27:30.767416 8446 leader_election.cc:341] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.767444 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:30.768982 8446 leader_election.cc:341] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.769325 8446 leader_election.cc:302] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:30.770191 10442 raft_consensus.cc:2726] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:30.776957 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]
I20260812 19:27:30.778566 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]
I20260812 19:27:30.781199 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:30.785831 8173 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:30.791375 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:30.806226 8627 tablet_bootstrap.cc:492] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:30.806650 8627 ts_tablet_manager.cc:1397] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.153s user 0.010s sys 0.000s
I20260812 19:27:30.807111 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569]
I20260812 19:27:30.808789 8627 raft_consensus.cc:348] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.809432 8627 raft_consensus.cc:374] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:30.809679 8627 raft_consensus.cc:729] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:30.810190 8627 consensus_queue.cc:260] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.813269 8627 ts_tablet_manager.cc:1428] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260812 19:27:30.830217 8623 tablet_bootstrap.cc:654] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:30.830307 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:30.831008 8509 raft_consensus.cc:2379] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:30.834009 8443 leader_election.cc:302] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:30.834744 10322 raft_consensus.cc:2781] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:30.835067 10322 raft_consensus.cc:482] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:30.835363 10322 raft_consensus.cc:3037] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:30.841701 10322 raft_consensus.cc:504] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.851913 8627 tablet_bootstrap.cc:492] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:30.853446 8443 leader_election.cc:302] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:30.854558 10442 raft_consensus.cc:2781] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:30.855291 10442 raft_consensus.cc:686] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:30.856173 10442 consensus_queue.cc:237] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.864955 8636 tablet_bootstrap.cc:700] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent opening tablet: real 0.105s user 0.004s sys 0.000s
I20260812 19:27:30.865684 8636 tablet_bootstrap.cc:654] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:30.868142 10322 leader_election.cc:288] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:30.877868 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc]
I20260812 19:27:30.892146 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]
I20260812 19:27:30.897096 8627 tablet_bootstrap.cc:654] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:30.896126 8443 leader_election.cc:341] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.904640 8636 tablet_bootstrap.cc:492] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:30.905138 8636 ts_tablet_manager.cc:1397] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.150s user 0.010s sys 0.000s
I20260812 19:27:30.907548 8636 raft_consensus.cc:348] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:30.910388 8443 leader_election.cc:341] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.908210 8636 raft_consensus.cc:374] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:30.913936 8636 raft_consensus.cc:729] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:30.915380 8636 consensus_queue.cc:260] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:30.927573 10334 consensus_queue.cc:1035] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:27:30.937177 8446 leader_election.cc:341] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.937484 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790]
W20260812 19:27:30.938617 8446 leader_election.cc:341] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:30.946539 8278 leader_election.cc:302] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:30.949366 8636 ts_tablet_manager.cc:1428] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20260812 19:27:30.950454 8636 tablet_bootstrap.cc:492] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:30.952359 10474 raft_consensus.cc:2781] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:30.952837 10474 raft_consensus.cc:686] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:30.953769 10474 consensus_queue.cc:237] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:30.975639 10426 consensus_queue.cc:1035] T 9b5e92063f494c79be75371f2626b1e3 P 6a95b50ceede4dc99913aec28ddaa380 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:31.008100 8623 tablet_bootstrap.cc:492] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:31.008225 8349 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbff8d38116d4af9ba9497f65e876827" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:31.008808 8349 raft_consensus.cc:3037] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:31.008948 8623 ts_tablet_manager.cc:1397] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.568s user 0.014s sys 0.007s
I20260812 19:27:31.012099 8623 raft_consensus.cc:348] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:31.013017 8623 raft_consensus.cc:374] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.013281 8623 raft_consensus.cc:729] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.015419 8627 tablet_bootstrap.cc:492] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:31.015887 8627 ts_tablet_manager.cc:1397] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.177s user 0.006s sys 0.004s
I20260812 19:27:31.016364 8349 raft_consensus.cc:2454] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:31.028775 8443 leader_election.cc:302] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:31.029740 10448 raft_consensus.cc:2781] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:31.030239 10448 raft_consensus.cc:686] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:31.031677 8636 tablet_bootstrap.cc:654] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.031081 10448 consensus_queue.cc:237] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:31.041821 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 265352us
I20260812 19:27:31.051079 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:31.076481 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]
I20260812 19:27:31.079373 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033]
I20260812 19:27:31.082082 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369]
W20260812 19:27:31.082866 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 49068.8us
I20260812 19:27:31.091034 8623 consensus_queue.cc:260] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:31.101605 8627 raft_consensus.cc:348] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.112085 8627 raft_consensus.cc:374] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.112419 8627 raft_consensus.cc:729] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.113162 8627 consensus_queue.cc:260] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.115236 8627 ts_tablet_manager.cc:1428] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.099s user 0.007s sys 0.000s
I20260812 19:27:31.116117 8627 tablet_bootstrap.cc:492] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:31.128744 8281 leader_election.cc:341] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.129171 8281 leader_election.cc:302] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:31.132311 10463 raft_consensus.cc:2726] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260812 19:27:31.133822 8281 consensus_peers.cc:487] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2b04529031f04302846b39d585d74ad5. This is attempt 6: this message will repeat every 5th retry.
I20260812 19:27:31.141396 10461 raft_consensus.cc:482] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:31.141947 10461 raft_consensus.cc:504] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.144145 10461 leader_election.cc:288] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:31.146363 10494 log.cc:924] Time spent T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.114s user 0.000s sys 0.000s
I20260812 19:27:31.146420 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a]
I20260812 19:27:31.147848 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4]
I20260812 19:27:31.149190 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067]
I20260812 19:27:31.158594 8623 ts_tablet_manager.cc:1428] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.149s user 0.002s sys 0.004s
I20260812 19:27:31.160099 8623 tablet_bootstrap.cc:492] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:31.181210 8627 tablet_bootstrap.cc:654] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.215207 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:31.224584 8281 leader_election.cc:341] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.226440 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8]
I20260812 19:27:31.231942 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:31.233537 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbff8d38116d4af9ba9497f65e876827" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:31.249953 8627 tablet_bootstrap.cc:492] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:31.250368 8627 ts_tablet_manager.cc:1397] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.134s user 0.009s sys 0.000s
I20260812 19:27:31.252851 8627 raft_consensus.cc:348] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.253557 8627 raft_consensus.cc:374] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.253796 8627 raft_consensus.cc:729] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.252415 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e]
I20260812 19:27:31.254372 8627 consensus_queue.cc:260] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.256772 8627 ts_tablet_manager.cc:1428] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 19:27:31.258234 8623 tablet_bootstrap.cc:654] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.261324 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f]
I20260812 19:27:31.268729 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]
I20260812 19:27:31.291359 8627 tablet_bootstrap.cc:492] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
W20260812 19:27:31.294095 8446 leader_election.cc:341] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.294512 8446 leader_election.cc:302] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:31.288928 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_abc701c69d604e08b2c81f972eeeb6e8 [id=6ad4b3f784244d538e0836d507969cdc]
I20260812 19:27:31.295112 10442 raft_consensus.cc:2726] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:31.296705 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47]
I20260812 19:27:31.320277 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2]
I20260812 19:27:31.322252 8627 tablet_bootstrap.cc:654] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.324283 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_5286b447ea52443c84d86022710997bc [id=74900250511b43f88349feed817b332d]
I20260812 19:27:31.325706 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 [id=74a2d08bc0c84a5588100bf04f828cf2]
I20260812 19:27:31.331314 8636 tablet_bootstrap.cc:492] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:31.331735 8636 ts_tablet_manager.cc:1397] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.381s user 0.008s sys 0.002s
I20260812 19:27:31.335019 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_61a721fd804b43e280c455210e7cabd8 [id=74c19f2de82344a69c7314ac3012fb9f]
W20260812 19:27:31.339098 8446 leader_election.cc:341] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.339536 8446 leader_election.cc:302] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:31.344369 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_848e8c259ba3498d9a99ca7a371c2e2d [id=7aef5ac0f0b24593a0c78e7d3864eb09]
I20260812 19:27:31.346349 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e]
I20260812 19:27:31.347723 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_d919a6bee2304ccab308b3d08e5be52c [id=82b4d20f40ab43c990959b458f3b11e4]
I20260812 19:27:31.350610 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f4fba6ed708046e48420257d6693f0c3 [id=8963896ef496485ba2eff5e329a70150]
I20260812 19:27:31.355844 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_72d530bd566d4fa889dd5304f5700a9f [id=8a03ad9f190045adb9f8a0c32c53ab7e]
I20260812 19:27:31.362002 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b35d6b9c90d24b21890d1b174ae92bdb [id=8c765506f69741cb85ac43172fc40548]
I20260812 19:27:31.362003 10442 raft_consensus.cc:2726] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:31.368577 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]
W20260812 19:27:31.369252 8446 leader_election.cc:341] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.369644 8446 leader_election.cc:302] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:31.370325 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_495da693476b4874bb497da7998bf531 [id=937c9f4b3b8546d6958017575c2ca587]
I20260812 19:27:31.370734 10502 raft_consensus.cc:2726] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260812 19:27:31.371649 8446 leader_election.cc:341] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.390448 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_bcd87c04648c489e9d444bbc8470ccd7 [id=95e83940f5bc4baeba825114eadde1a5]
I20260812 19:27:31.390362 8636 raft_consensus.cc:348] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.392710 10501 raft_consensus.cc:482] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:31.393486 10501 raft_consensus.cc:504] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.391076 8636 raft_consensus.cc:374] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.396423 8636 raft_consensus.cc:729] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.402153 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9aa94ea25c04790902a3a4d0c0099ad" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:31.402842 8352 raft_consensus.cc:2454] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:31.404104 8443 leader_election.cc:302] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:31.404946 10502 raft_consensus.cc:2781] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:31.405504 10502 raft_consensus.cc:482] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:31.406198 10502 raft_consensus.cc:3037] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:31.407302 8623 tablet_bootstrap.cc:492] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:31.407743 8623 ts_tablet_manager.cc:1397] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.248s user 0.003s sys 0.007s
I20260812 19:27:31.423830 10501 leader_election.cc:288] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:31.427966 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:31.429040 8508 raft_consensus.cc:2454] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:31.433830 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701]
I20260812 19:27:31.416530 8636 consensus_queue.cc:260] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.445621 8636 ts_tablet_manager.cc:1428] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.114s user 0.007s sys 0.002s
I20260812 19:27:31.446801 8636 tablet_bootstrap.cc:492] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:31.453389 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]
I20260812 19:27:31.456040 8623 raft_consensus.cc:348] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.456969 8623 raft_consensus.cc:374] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.457340 8623 raft_consensus.cc:729] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.458145 8623 consensus_queue.cc:260] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.494565 8623 ts_tablet_manager.cc:1428] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.087s user 0.005s sys 0.004s
I20260812 19:27:31.526788 10442 raft_consensus.cc:482] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:31.527374 10442 raft_consensus.cc:504] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.529940 10442 leader_election.cc:288] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:31.531267 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:31.533641 8627 tablet_bootstrap.cc:492] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
W20260812 19:27:31.533520 8443 leader_election.cc:341] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.534053 8627 ts_tablet_manager.cc:1397] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.243s user 0.015s sys 0.001s
I20260812 19:27:31.537411 8627 raft_consensus.cc:348] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.538067 8627 raft_consensus.cc:374] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.538318 8627 raft_consensus.cc:729] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.538885 8627 consensus_queue.cc:260] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.546352 8278 leader_election.cc:302] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:31.547109 10474 raft_consensus.cc:2781] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:31.547434 10474 raft_consensus.cc:482] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:31.547724 10474 raft_consensus.cc:3037] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:31.549335 8627 ts_tablet_manager.cc:1428] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.015s user 0.006s sys 0.001s
I20260812 19:27:31.556295 10474 raft_consensus.cc:504] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.558867 10474 leader_election.cc:288] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:31.561255 8623 tablet_bootstrap.cc:492] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:31.565513 8177 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:31.566797 8281 leader_election.cc:341] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.574414 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9aa94ea25c04790902a3a4d0c0099ad" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:31.574657 10502 raft_consensus.cc:504] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.576817 8627 tablet_bootstrap.cc:492] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:31.580068 10442 raft_consensus.cc:482] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:31.580618 10442 raft_consensus.cc:504] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.582966 10442 leader_election.cc:288] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:31.592453 10442 raft_consensus.cc:482] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:31.593043 10442 raft_consensus.cc:504] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:31.595597 10442 leader_election.cc:288] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:31.595912 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_1068c7ccc7344a52934df17a65628581 [id=98f3d7d36ae249acac9dfe885cd2484e]
I20260812 19:27:31.598407 8636 tablet_bootstrap.cc:654] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.603137 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:31.603847 8508 raft_consensus.cc:3037] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:31.611387 8508 raft_consensus.cc:2454] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:31.613574 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9aa94ea25c04790902a3a4d0c0099ad" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:31.614123 8352 raft_consensus.cc:3037] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:31.615782 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_565297bf6a384bfb86c95a16c2f98f4e [id=9b1730bdd60e490cadcc3292926e6f96]
I20260812 19:27:31.617202 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_711ff99c0d184bbd8214b29510d407cc [id=9b70345d8fa242b886b0fcf6433af593]
I20260812 19:27:31.621089 8352 raft_consensus.cc:2454] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:31.631551 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:31.651762 8178 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:31.653801 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:31.665066 8623 tablet_bootstrap.cc:654] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.630301 8443 leader_election.cc:302] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
W20260812 19:27:31.668505 8443 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
W20260812 19:27:31.669085 8443 leader_election.cc:341] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.669724 10501 raft_consensus.cc:2781] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:31.670184 10501 raft_consensus.cc:686] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:31.670928 10501 consensus_queue.cc:237] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.677235 10502 leader_election.cc:288] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:31.677505 8627 tablet_bootstrap.cc:654] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.686761 10448 consensus_queue.cc:1035] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:31.714731 8636 tablet_bootstrap.cc:492] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:31.737020 10516 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:31.737694 10516 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:31.741075 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:31.742399 8636 ts_tablet_manager.cc:1397] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.296s user 0.014s sys 0.000s
I20260812 19:27:31.744863 8636 raft_consensus.cc:348] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.745572 8636 raft_consensus.cc:374] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.745812 8636 raft_consensus.cc:729] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
W20260812 19:27:31.717244 8446 leader_election.cc:341] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.746184 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec]
I20260812 19:27:31.750516 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_916f8c0b79394ffc9e296b898a1f93ec [id=9d6691884d174daba49818fe5d1529ac]
W20260812 19:27:31.750821 8446 leader_election.cc:341] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.751199 8446 leader_election.cc:302] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:31.752099 10448 raft_consensus.cc:2726] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:31.765688 8623 tablet_bootstrap.cc:492] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:31.771422 8623 ts_tablet_manager.cc:1397] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.210s user 0.005s sys 0.005s
I20260812 19:27:31.772423 8627 tablet_bootstrap.cc:492] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:31.772840 8627 ts_tablet_manager.cc:1397] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.196s user 0.010s sys 0.000s
I20260812 19:27:31.777084 10516 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
W20260812 19:27:31.785930 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.746s (SENT)
I20260812 19:27:31.786456 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
W20260812 19:27:31.790360 8446 leader_election.cc:341] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 5bce01fd81f04f23a8cddc3a7b5eae8f
I20260812 19:27:31.790835 8446 leader_election.cc:302] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:31.793162 10502 raft_consensus.cc:2726] T 5bce01fd81f04f23a8cddc3a7b5eae8f P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:31.802067 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]
I20260812 19:27:31.815224 8636 consensus_queue.cc:260] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.822474 10518 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:27:31.775231 8627 raft_consensus.cc:348] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.825299 8627 raft_consensus.cc:374] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260812 19:27:31.822324 8446 leader_election.cc:341] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:31.836556 8446 leader_election.cc:302] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:31.840096 8636 ts_tablet_manager.cc:1428] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.097s user 0.005s sys 0.000s
I20260812 19:27:31.841180 8636 tablet_bootstrap.cc:492] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:31.787858 8623 raft_consensus.cc:348] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.849113 8623 raft_consensus.cc:374] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:31.849603 8623 raft_consensus.cc:729] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.856534 8623 consensus_queue.cc:260] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.860981 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_87cb1dcf475941269e6d752d00e0df9b [id=9e80dff3c6904e2eb80288a122698ec7]
I20260812 19:27:31.863648 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_a059cc3e3a9345ddbd2e7c031966470f [id=a095e4d6dde54adfbd59686c9e67d995]
I20260812 19:27:31.825698 8627 raft_consensus.cc:729] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:31.866456 8627 consensus_queue.cc:260] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:31.867063 8623 ts_tablet_manager.cc:1428] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.094s user 0.006s sys 0.001s
I20260812 19:27:31.868850 10484 raft_consensus.cc:482] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:31.871958 10484 raft_consensus.cc:504] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:31.877168 10394 raft_consensus.cc:2726] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:31.880784 10484 leader_election.cc:288] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:31.883896 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b32b8e857c04567a2a751c379a05440" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:31.888814 8508 raft_consensus.cc:2379] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:31.901942 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6b32b8e857c04567a2a751c379a05440" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:31.903667 8108 leader_election.cc:302] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:31.905719 8623 tablet_bootstrap.cc:492] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:31.907490 10481 raft_consensus.cc:3037] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:31.928653 8636 tablet_bootstrap.cc:654] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:31.945497 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f9aa94ea25c04790902a3a4d0c0099ad" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:31.990741 8627 ts_tablet_manager.cc:1428] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.218s user 0.008s sys 0.002s
I20260812 19:27:31.994316 8627 tablet_bootstrap.cc:492] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:32.003216 10481 raft_consensus.cc:2726] T 6b32b8e857c04567a2a751c379a05440 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:32.003679 8176 raft_consensus.cc:3037] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:32.014132 10526 consensus_queue.cc:1035] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260812 19:27:32.013674 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f429f2bd365a4d5fa9bd32e3d490473b [id=a7e6cd0f83cc491cb3f68098aab6dbab]
I20260812 19:27:32.034485 8623 tablet_bootstrap.cc:654] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:32.034559 10501 raft_consensus.cc:482] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.035032 10501 raft_consensus.cc:504] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.037247 10501 leader_election.cc:288] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.040990 10523 raft_consensus.cc:482] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.041896 10523 raft_consensus.cc:504] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.044495 10523 leader_election.cc:288] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.046204 8172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:32.047266 8281 leader_election.cc:341] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.048715 10527 raft_consensus.cc:482] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.049256 10527 raft_consensus.cc:504] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.055008 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:32.055969 8278 leader_election.cc:302] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:32.057325 10526 raft_consensus.cc:2781] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:32.058336 10526 raft_consensus.cc:686] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:32.059262 10526 consensus_queue.cc:237] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:32.063256 8446 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 92014.4us
I20260812 19:27:32.064549 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4]
I20260812 19:27:32.066937 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_c4c3334f5a0b4458b574b4398a96f702 [id=ab7a42f74d6646a7a5fc1f6e0484ab95]
W20260812 19:27:32.070103 8446 leader_election.cc:341] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.070243 8627 tablet_bootstrap.cc:654] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:32.073530 8636 tablet_bootstrap.cc:492] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:32.073964 8636 ts_tablet_manager.cc:1397] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.233s user 0.009s sys 0.000s
I20260812 19:27:32.086544 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:32.108745 8623 tablet_bootstrap.cc:492] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:32.109278 8623 ts_tablet_manager.cc:1397] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.204s user 0.013s sys 0.004s
I20260812 19:27:32.068243 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_c5c2449187eb429faa8378da84b0adad [id=ad18f22ffe3f4fa58ed87253a5c6080e]
I20260812 19:27:32.111842 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_51762252a63548a9bf108b1eed133662 [id=af0b194d7f274839bc613a16526ce7a3]
I20260812 19:27:32.111986 10527 leader_election.cc:288] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.113257 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d]
I20260812 19:27:32.114444 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]
I20260812 19:27:32.116922 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:32.118479 8281 leader_election.cc:341] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.120718 8623 raft_consensus.cc:348] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:32.121380 8623 raft_consensus.cc:374] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:32.121614 8623 raft_consensus.cc:729] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:32.122136 8623 consensus_queue.cc:260] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:32.137822 8623 ts_tablet_manager.cc:1428] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20260812 19:27:32.138761 8623 tablet_bootstrap.cc:492] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:32.164157 8443 leader_election.cc:341] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.166769 10448 consensus_queue.cc:1035] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:32.169010 8636 raft_consensus.cc:348] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.169682 8636 raft_consensus.cc:374] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:32.169920 8636 raft_consensus.cc:729] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:32.170457 8636 consensus_queue.cc:260] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.186630 8636 ts_tablet_manager.cc:1428] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.112s user 0.007s sys 0.000s
W20260812 19:27:32.215693 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 144779us
I20260812 19:27:32.219503 10476 consensus_queue.cc:1035] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:32.238770 10526 raft_consensus.cc:482] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.239231 10526 raft_consensus.cc:504] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.241551 10526 leader_election.cc:288] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.257525 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:32.258092 8511 raft_consensus.cc:2454] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:32.258836 8508 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:32.259403 8508 raft_consensus.cc:2454] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:32.265671 10502 consensus_queue.cc:1035] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:27:32.266713 8446 leader_election.cc:341] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.263522 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc0601e681ba426991b22b6a7303ae2c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:32.267843 8511 raft_consensus.cc:2454] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:32.267629 8446 leader_election.cc:302] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:32.268930 10501 raft_consensus.cc:2726] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:32.269371 8627 tablet_bootstrap.cc:492] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:32.269788 8627 ts_tablet_manager.cc:1397] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.276s user 0.013s sys 0.000s
W20260812 19:27:32.270318 8446 consensus_peers.cc:487] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.279584 8278 leader_election.cc:302] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:32.280938 10526 raft_consensus.cc:2781] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:32.281939 10526 raft_consensus.cc:482] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:32.283020 10526 raft_consensus.cc:3037] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:32.289755 8278 leader_election.cc:302] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:32.293155 10523 raft_consensus.cc:2781] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:32.294147 10523 raft_consensus.cc:482] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:32.272109 8627 raft_consensus.cc:348] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.299851 8627 raft_consensus.cc:374] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:32.300122 8627 raft_consensus.cc:729] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:32.315760 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_e3b24459b2554cd3883378cdf0a9fb61 [id=bb604741b9c044d082ffa9daf4fe8d74]
I20260812 19:27:32.317339 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_3edb2611b0cb4de78624e0ffdf32222c [id=bb9e313afbcf4be9a295e94b16bbecc3]
I20260812 19:27:32.319604 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b8f8f3637e9344998414afa9cf1f2d45 [id=bfa823ee749942f5898a16fa6a064fe6]
I20260812 19:27:32.324983 10501 raft_consensus.cc:482] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.324555 8627 consensus_queue.cc:260] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.325403 10501 raft_consensus.cc:504] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.326153 8627 ts_tablet_manager.cc:1428] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.056s user 0.005s sys 0.000s
I20260812 19:27:32.327204 8627 tablet_bootstrap.cc:492] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:32.328358 8356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:32.329797 8443 leader_election.cc:341] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.328843 10501 leader_election.cc:288] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.338217 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]
I20260812 19:27:32.339653 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_4b45622c6d97488f977a6ef6b04ac74e [id=c625aebe1cfc488cb159c2796db94108]
I20260812 19:27:32.362885 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_bbda5db214af4795b1d794c0bfa3b278 [id=c8606c010ad14f069ef54b863a2010e3]
I20260812 19:27:32.385809 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]
I20260812 19:27:32.387539 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_02dbea084f02412db88eb169e6bb5cf7 [id=d797b2d682e04058b7e8645792516973]
I20260812 19:27:32.389101 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_65e0e363703e439ea5476db643057688 [id=d7a96e113ac74e29bb7f9be4d43d7fa8]
I20260812 19:27:32.392359 10527 raft_consensus.cc:482] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.392779 8627 tablet_bootstrap.cc:654] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:32.393086 10527 raft_consensus.cc:504] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.398952 10527 leader_election.cc:288] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.295280 10523 raft_consensus.cc:3037] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:32.409816 8278 leader_election.cc:302] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:32.411474 10476 raft_consensus.cc:2781] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:32.411979 10476 raft_consensus.cc:482] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:32.412499 10476 raft_consensus.cc:3037] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:32.437896 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc0601e681ba426991b22b6a7303ae2c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:32.438458 8627 tablet_bootstrap.cc:492] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:32.439117 8627 ts_tablet_manager.cc:1397] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.112s user 0.014s sys 0.003s
I20260812 19:27:32.439504 10407 raft_consensus.cc:482] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.441216 10407 raft_consensus.cc:504] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.445688 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c]
I20260812 19:27:32.446161 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140266bae6254efe9b87d0f8e3bfaa4e" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:32.447535 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]
I20260812 19:27:32.448812 10407 leader_election.cc:288] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:32.451766 8627 raft_consensus.cc:348] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.452764 8627 raft_consensus.cc:374] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:32.453130 8627 raft_consensus.cc:729] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:32.453929 8627 consensus_queue.cc:260] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.455256 10481 raft_consensus.cc:482] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.455950 10481 raft_consensus.cc:504] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.479105 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_1ffdf4360f8748df9e45c5b04dc093e5 [id=e2abe957f6434f35a9da50378bd4aa35]
I20260812 19:27:32.481417 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]
I20260812 19:27:32.481954 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:32.482779 8511 raft_consensus.cc:2379] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:32.482842 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_fac2d883e0444e638b031f6bd0209b93 [id=e878f91b7f3749eb9acd213ea6e31430]
I20260812 19:27:32.484591 10481 leader_election.cc:288] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:32.493234 8627 ts_tablet_manager.cc:1428] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.054s user 0.008s sys 0.002s
I20260812 19:27:32.494405 8627 tablet_bootstrap.cc:492] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:32.503585 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:32.504209 8516 raft_consensus.cc:2454] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:32.515180 10526 raft_consensus.cc:504] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.522171 8278 leader_election.cc:302] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:32.523293 10334 raft_consensus.cc:2781] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:32.523716 10334 raft_consensus.cc:482] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:32.524117 10334 raft_consensus.cc:3037] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:32.530154 8627 tablet_bootstrap.cc:654] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:32.536353 8623 tablet_bootstrap.cc:700] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380: Time spent opening tablet: real 0.384s user 0.004s sys 0.000s
I20260812 19:27:32.537248 8623 tablet_bootstrap.cc:654] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:32.563347 10442 consensus_queue.cc:1035] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:32.484226 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_c1665280164645aeaa0ada50bf7e6629 [id=ea7ebd72106345978b7ccd28e8599c2b]
I20260812 19:27:32.579757 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]
I20260812 19:27:32.579841 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:32.581065 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b25383bb16404fac95cc1d79e20e1185 [id=ed6829a78ccb41109d1f99403f38ddb3]
I20260812 19:27:32.583583 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318]
I20260812 19:27:32.608496 10547 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:32.608996 10547 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:32.611629 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:32.620347 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:32.623323 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]
W20260812 19:27:32.615294 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 64134.2us
I20260812 19:27:32.620654 10334 raft_consensus.cc:504] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.632076 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7bbd6b066d084c81b9307f7db324d95f [id=f832c3b9d1784bb1b4794513d4832db8]
W20260812 19:27:32.625901 8281 leader_election.cc:341] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.639166 10334 leader_election.cc:288] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.648934 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_0c169ee9078f4bed9f0e3611083f1540 [id=fb2cc5bfeacf477fb0455ef2c27cd2be]
I20260812 19:27:32.652390 10547 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:32.652133 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_4ba940c06806406eb455a26f9e2c0917 [id=fe03d45525a94b4d8980f8b96e14c696]
I20260812 19:27:32.681658 8623 tablet_bootstrap.cc:492] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:32.682157 8623 ts_tablet_manager.cc:1397] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.544s user 0.007s sys 0.003s
I20260812 19:27:32.688364 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:32.697868 8623 raft_consensus.cc:348] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.552217 10476 raft_consensus.cc:504] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.703258 8623 raft_consensus.cc:374] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:32.703578 8623 raft_consensus.cc:729] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:32.704895 10476 leader_election.cc:288] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.709849 8623 consensus_queue.cc:260] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.711970 8623 ts_tablet_manager.cc:1428] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.029s user 0.004s sys 0.002s
I20260812 19:27:32.712965 8623 tablet_bootstrap.cc:492] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:32.726801 8446 leader_election.cc:341] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.727309 8446 leader_election.cc:302] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:32.728626 10502 raft_consensus.cc:2726] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:32.671988 10526 leader_election.cc:288] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:32.683687 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 105765us
I20260812 19:27:32.743966 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "140266bae6254efe9b87d0f8e3bfaa4e" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:32.745770 8627 tablet_bootstrap.cc:492] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:32.746201 8627 ts_tablet_manager.cc:1397] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.252s user 0.006s sys 0.005s
I20260812 19:27:32.748090 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f6f3a2193f2744249de635be4f949889" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:32.755466 10523 raft_consensus.cc:504] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.756461 8627 raft_consensus.cc:348] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.757128 8627 raft_consensus.cc:374] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:32.767426 8627 raft_consensus.cc:729] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:32.768038 8627 consensus_queue.cc:260] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.769621 8627 ts_tablet_manager.cc:1428] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20260812 19:27:32.770568 8627 tablet_bootstrap.cc:492] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:32.777966 8623 tablet_bootstrap.cc:654] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:32.797509 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:32.802518 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc0601e681ba426991b22b6a7303ae2c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:32.803594 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:32.804081 8281 leader_election.cc:341] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.812572 9735 tablet_loader.cc:96] loaded metadata for tablet 01063b51cc35482c918f74b43fa3ee8f (table default.Table_e3b24459b2554cd3883378cdf0a9fb61 [id=bb604741b9c044d082ffa9daf4fe8d74])
I20260812 19:27:32.816144 9735 tablet_loader.cc:96] loaded metadata for tablet 05b8e6cecfa04aa685014277c15fb6f4 (table default.Table_fac2d883e0444e638b031f6bd0209b93 [id=e878f91b7f3749eb9acd213ea6e31430])
W20260812 19:27:32.817534 8281 leader_election.cc:341] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.827814 9735 tablet_loader.cc:96] loaded metadata for tablet 067fdfc16a7e44c2b3dac5fe262a5728 (table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce])
I20260812 19:27:32.829387 9735 tablet_loader.cc:96] loaded metadata for tablet 0df3401001074c62883da06902530399 (table default.Table_4ba940c06806406eb455a26f9e2c0917 [id=fe03d45525a94b4d8980f8b96e14c696])
I20260812 19:27:32.831096 9735 tablet_loader.cc:96] loaded metadata for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44])
W20260812 19:27:32.843497 8281 leader_election.cc:341] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:32.844509 8281 leader_election.cc:341] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:32.845017 8281 leader_election.cc:341] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:32.845467 9735 tablet_loader.cc:96] loaded metadata for tablet 11eb974d35ba42418292e5a9fa82e331 (table default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07])
I20260812 19:27:32.847299 9735 tablet_loader.cc:96] loaded metadata for tablet 13607c1893434a728d989eb1c8c88eea (table default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033])
I20260812 19:27:32.848448 9735 tablet_loader.cc:96] loaded metadata for tablet 140266bae6254efe9b87d0f8e3bfaa4e (table default.Table_51762252a63548a9bf108b1eed133662 [id=af0b194d7f274839bc613a16526ce7a3])
I20260812 19:27:32.857466 9735 tablet_loader.cc:96] loaded metadata for tablet 1950030ab501429a91971f80f761a172 (table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277])
W20260812 19:27:32.862531 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 124707us
I20260812 19:27:32.866848 9735 tablet_loader.cc:96] loaded metadata for tablet 2175811e6a7646c3ae82daaa8c626bca (table default.Table_65e0e363703e439ea5476db643057688 [id=d7a96e113ac74e29bb7f9be4d43d7fa8])
I20260812 19:27:32.875269 9735 tablet_loader.cc:96] loaded metadata for tablet 29436abddcab4a46adb5aa0c54f45389 (table default.Table_c5c2449187eb429faa8378da84b0adad [id=ad18f22ffe3f4fa58ed87253a5c6080e])
W20260812 19:27:32.880820 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 151917us
I20260812 19:27:32.897183 10523 leader_election.cc:288] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:32.897651 9735 tablet_loader.cc:96] loaded metadata for tablet 30940fe1277e4347941f3525f6448cdb (table default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca])
I20260812 19:27:32.899329 9735 tablet_loader.cc:96] loaded metadata for tablet 311b68f298164090bc9458e3ee16f6cb (table default.Table_3edb2611b0cb4de78624e0ffdf32222c [id=bb9e313afbcf4be9a295e94b16bbecc3])
I20260812 19:27:32.900560 9735 tablet_loader.cc:96] loaded metadata for tablet 33591e906f0e433d98e07e424ea0b07f (table default.Table_c4c3334f5a0b4458b574b4398a96f702 [id=ab7a42f74d6646a7a5fc1f6e0484ab95])
I20260812 19:27:32.901698 9735 tablet_loader.cc:96] loaded metadata for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_f429f2bd365a4d5fa9bd32e3d490473b [id=a7e6cd0f83cc491cb3f68098aab6dbab])
I20260812 19:27:32.903018 8627 tablet_bootstrap.cc:654] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:32.904588 10407 raft_consensus.cc:482] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.905400 10407 raft_consensus.cc:504] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:32.912341 10407 leader_election.cc:288] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:32.912871 9735 tablet_loader.cc:96] loaded metadata for tablet 354d9912acad4c1ba76f45ce277f1e94 (table default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0])
I20260812 19:27:32.913918 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:32.914214 9735 tablet_loader.cc:96] loaded metadata for tablet 355b9f4f5ada428789aa871c888843e1 (table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569])
I20260812 19:27:32.915027 8516 raft_consensus.cc:2379] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:32.916179 10552 raft_consensus.cc:482] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:32.916891 10552 raft_consensus.cc:504] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:32.919272 9735 tablet_loader.cc:96] loaded metadata for tablet 538d05c5883d4575b8eb5d42dfb3c246 (table default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c])
I20260812 19:27:32.934064 9735 tablet_loader.cc:96] loaded metadata for tablet 5717f521074d49c6baec431f0d739c91 (table default.Table_61a721fd804b43e280c455210e7cabd8 [id=74c19f2de82344a69c7314ac3012fb9f])
I20260812 19:27:32.940429 9735 tablet_loader.cc:96] loaded metadata for tablet 5db9e00d07964bde9f769e217236a771 (table default.Table_02dbea084f02412db88eb169e6bb5cf7 [id=d797b2d682e04058b7e8645792516973])
I20260812 19:27:32.953815 9735 tablet_loader.cc:96] loaded metadata for tablet 5f3c6d8f74d044948a893d756be9a838 (table default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f])
I20260812 19:27:32.963171 9735 tablet_loader.cc:96] loaded metadata for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d])
I20260812 19:27:32.963955 8175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:32.964782 9735 tablet_loader.cc:96] loaded metadata for tablet 622deb66eead473189ab85a53cb8c81f (table default.Table_87cb1dcf475941269e6d752d00e0df9b [id=9e80dff3c6904e2eb80288a122698ec7])
I20260812 19:27:32.969614 9735 tablet_loader.cc:96] loaded metadata for tablet 663d0d16b9cd4bed9bb5529b514f9e30 (table default.Table_f4fba6ed708046e48420257d6693f0c3 [id=8963896ef496485ba2eff5e329a70150])
I20260812 19:27:32.944796 10552 leader_election.cc:288] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:32.988548 8446 consensus_peers.cc:487] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:32.989789 9735 tablet_loader.cc:96] loaded metadata for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b (table default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb])
I20260812 19:27:32.999274 9735 tablet_loader.cc:96] loaded metadata for tablet 6b32b8e857c04567a2a751c379a05440 (table default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6])
I20260812 19:27:33.001883 9735 tablet_loader.cc:96] loaded metadata for tablet 6ff5b2d23d734217b0b10e50834b8883 (table default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893])
I20260812 19:27:33.010321 8623 tablet_bootstrap.cc:492] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:33.010814 8623 ts_tablet_manager.cc:1397] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.298s user 0.010s sys 0.010s
I20260812 19:27:33.014037 8623 raft_consensus.cc:348] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.014710 8623 raft_consensus.cc:374] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:33.014956 8623 raft_consensus.cc:729] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:33.015517 8623 consensus_queue.cc:260] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.018461 9735 tablet_loader.cc:96] loaded metadata for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8])
I20260812 19:27:33.021507 9735 tablet_loader.cc:96] loaded metadata for tablet 787047cca4ce4c6884ce5bd07a93f077 (table default.Table_abc701c69d604e08b2c81f972eeeb6e8 [id=6ad4b3f784244d538e0836d507969cdc])
I20260812 19:27:33.025796 8623 ts_tablet_manager.cc:1428] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.015s user 0.002s sys 0.003s
I20260812 19:27:33.026610 8623 tablet_bootstrap.cc:492] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:33.038856 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 76004us
W20260812 19:27:33.039821 8281 leader_election.cc:341] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:33.056699 9735 tablet_loader.cc:96] loaded metadata for tablet 7a530a6bcdb04b268c7a3f4becb065e2 (table default.Table_bcd87c04648c489e9d444bbc8470ccd7 [id=95e83940f5bc4baeba825114eadde1a5])
I20260812 19:27:33.056706 8108 leader_election.cc:302] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:33.062397 9735 tablet_loader.cc:96] loaded metadata for tablet 7b689d49a1244c7fb12ba84853f2da9d (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe])
I20260812 19:27:33.068527 9735 tablet_loader.cc:96] loaded metadata for tablet 7c258a18b8da47aabafd67023d3e5812 (table default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47])
I20260812 19:27:33.069506 8627 tablet_bootstrap.cc:492] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:33.069904 8627 ts_tablet_manager.cc:1397] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.299s user 0.020s sys 0.005s
I20260812 19:27:33.075223 9735 tablet_loader.cc:96] loaded metadata for tablet 818eae7a6645415e992c25565f7f3b5a (table default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a])
I20260812 19:27:33.072089 8627 raft_consensus.cc:348] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.079392 8627 raft_consensus.cc:374] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:33.079667 8627 raft_consensus.cc:729] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:33.080171 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:33.080235 8627 consensus_queue.cc:260] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.080760 8516 raft_consensus.cc:3037] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.087124 9735 tablet_loader.cc:96] loaded metadata for tablet 841c459584534458977b6182b71c77f1 (table default.Table_bbda5db214af4795b1d794c0bfa3b278 [id=c8606c010ad14f069ef54b863a2010e3])
I20260812 19:27:33.089315 9735 tablet_loader.cc:96] loaded metadata for tablet 867e426fedce4c9895b7b9a13f8bb5e3 (table default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790])
I20260812 19:27:33.090613 9735 tablet_loader.cc:96] loaded metadata for tablet 89298e977bef4f519f68446bf75d0df9 (table default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6])
W20260812 19:27:33.091941 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.654s (SENT)
I20260812 19:27:33.092516 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:33.099344 8516 raft_consensus.cc:2454] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:33.105619 8627 ts_tablet_manager.cc:1428] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.035s user 0.005s sys 0.002s
I20260812 19:27:33.115610 8627 tablet_bootstrap.cc:492] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:33.120682 9735 tablet_loader.cc:96] loaded metadata for tablet 8c9d071f07e5410d9e660986ab6858ef (table default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec])
I20260812 19:27:33.122443 9735 tablet_loader.cc:96] loaded metadata for tablet 9293d85d08c34dbeb3f324322f2d656c (table default.Table_848e8c259ba3498d9a99ca7a371c2e2d [id=7aef5ac0f0b24593a0c78e7d3864eb09])
I20260812 19:27:33.129313 9735 tablet_loader.cc:96] loaded metadata for tablet 92d412842c9c4dd0bb47e774d1df8e4b (table default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369])
I20260812 19:27:33.132010 9735 tablet_loader.cc:96] loaded metadata for tablet 95e195a643084486a74be961177bf42c (table default.Table_495da693476b4874bb497da7998bf531 [id=937c9f4b3b8546d6958017575c2ca587])
I20260812 19:27:33.133575 9735 tablet_loader.cc:96] loaded metadata for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0])
I20260812 19:27:33.134882 9735 tablet_loader.cc:96] loaded metadata for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701])
I20260812 19:27:33.145313 9735 tablet_loader.cc:96] loaded metadata for tablet 9b5e92063f494c79be75371f2626b1e3 (table default.Table_4b45622c6d97488f977a6ef6b04ac74e [id=c625aebe1cfc488cb159c2796db94108])
I20260812 19:27:33.146723 9735 tablet_loader.cc:96] loaded metadata for tablet 9bdb7cce923c4ed98e400c121b6237ba (table default.Table_c1665280164645aeaa0ada50bf7e6629 [id=ea7ebd72106345978b7ccd28e8599c2b])
I20260812 19:27:33.147909 9735 tablet_loader.cc:96] loaded metadata for tablet 9be4dabb7fa042bd8fa6b45fa63e8674 (table default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4])
I20260812 19:27:33.149394 9735 tablet_loader.cc:96] loaded metadata for tablet 9f0afa2f3cee483facfbb2712917b829 (table default.Table_1068c7ccc7344a52934df17a65628581 [id=98f3d7d36ae249acac9dfe885cd2484e])
I20260812 19:27:33.150734 9735 tablet_loader.cc:96] loaded metadata for tablet a06d3ff29cc14599bce1531a7b63f072 (table default.Table_72d530bd566d4fa889dd5304f5700a9f [id=8a03ad9f190045adb9f8a0c32c53ab7e])
I20260812 19:27:33.153342 9735 tablet_loader.cc:96] loaded metadata for tablet a2b4ef63a53540e6be590243b1d27330 (table default.Table_7bbd6b066d084c81b9307f7db324d95f [id=f832c3b9d1784bb1b4794513d4832db8])
I20260812 19:27:33.159962 9735 tablet_loader.cc:96] loaded metadata for tablet a91c4d5adb3d4f97939e38e9cee79532 (table default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285])
I20260812 19:27:33.176342 9735 tablet_loader.cc:96] loaded metadata for tablet aff8c4a6f27c499eb555d97017cb3a4c (table default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2])
I20260812 19:27:33.181712 9735 tablet_loader.cc:96] loaded metadata for tablet b00a037a2567470497e1a751754df345 (table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067])
I20260812 19:27:33.182906 9735 tablet_loader.cc:96] loaded metadata for tablet b07f7215876740519164e7d7e08302bd (table default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970])
I20260812 19:27:33.189841 9735 tablet_loader.cc:96] loaded metadata for tablet b31c1afb090041d7b6ae35a846772b1d (table default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4])
I20260812 19:27:33.206065 9735 tablet_loader.cc:96] loaded metadata for tablet b4d07516dc1c4193b4cbd68185f92891 (table default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b])
I20260812 19:27:33.209901 9735 tablet_loader.cc:96] loaded metadata for tablet b51a28468ba74a8e88d0936dc3281eca (table default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685])
I20260812 19:27:33.172161 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:33.212980 8511 raft_consensus.cc:3037] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.172749 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc0601e681ba426991b22b6a7303ae2c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:33.216687 8510 raft_consensus.cc:3037] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.222095 9735 tablet_loader.cc:96] loaded metadata for tablet b7d4a12b9c14415e8449d39663296450 (table default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e])
I20260812 19:27:33.224860 8510 raft_consensus.cc:2454] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:33.227557 8511 raft_consensus.cc:2454] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:33.232558 10542 raft_consensus.cc:2726] T 140266bae6254efe9b87d0f8e3bfaa4e P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:27:33.261198 9735 tablet_loader.cc:96] loaded metadata for tablet bc8ae6adf7b64a468112753c2831ac87 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be])
I20260812 19:27:33.270213 9735 tablet_loader.cc:96] loaded metadata for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc])
I20260812 19:27:33.271623 9735 tablet_loader.cc:96] loaded metadata for tablet c607886a76344185aa9af5da797b9ae8 (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6])
I20260812 19:27:33.272853 9735 tablet_loader.cc:96] loaded metadata for tablet c67135f8c5ae422485bca11ada90afaa (table default.Table_d919a6bee2304ccab308b3d08e5be52c [id=82b4d20f40ab43c990959b458f3b11e4])
I20260812 19:27:33.273945 9735 tablet_loader.cc:96] loaded metadata for tablet c881ad61438d4a978e3c479aefcfa4cb (table default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825])
W20260812 19:27:33.278669 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 222017us
I20260812 19:27:33.282644 8108 leader_election.cc:302] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:33.283429 10481 raft_consensus.cc:3037] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.284232 9735 tablet_loader.cc:96] loaded metadata for tablet cc0601e681ba426991b22b6a7303ae2c (table default.Table_b25383bb16404fac95cc1d79e20e1185 [id=ed6829a78ccb41109d1f99403f38ddb3])
I20260812 19:27:33.285224 9735 tablet_loader.cc:96] loaded metadata for tablet cdb6ba8b98474fff97ae3f45218870f0 (table default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318])
I20260812 19:27:33.287952 9735 tablet_loader.cc:96] loaded metadata for tablet d30c274273c3496cb0a8b8650b504250 (table default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b])
I20260812 19:27:33.306857 9735 tablet_loader.cc:96] loaded metadata for tablet d49351be8d2a40109d88b54db11c4489 (table default.Table_b35d6b9c90d24b21890d1b174ae92bdb [id=8c765506f69741cb85ac43172fc40548])
I20260812 19:27:33.315733 8515 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:33.316311 8515 raft_consensus.cc:3037] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.317757 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:33.319370 8511 raft_consensus.cc:2454] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:33.322784 8515 raft_consensus.cc:2454] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:33.325138 10560 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:27:33.337879 9735 tablet_loader.cc:96] loaded metadata for tablet d4d4e8d3d6ef40058b29f7cc574a5565 (table default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050])
I20260812 19:27:33.339107 9735 tablet_loader.cc:96] loaded metadata for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6 (table default.Table_711ff99c0d184bbd8214b29510d407cc [id=9b70345d8fa242b886b0fcf6433af593])
W20260812 19:27:33.342063 7781 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 250145us
I20260812 19:27:33.356714 10481 raft_consensus.cc:2726] T f6f3a2193f2744249de635be4f949889 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:33.360569 9735 tablet_loader.cc:96] loaded metadata for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0])
I20260812 19:27:33.361690 9735 tablet_loader.cc:96] loaded metadata for tablet e0451c2d5d6b4851a83ee9d30aa40a6c (table default.Table_b8f8f3637e9344998414afa9cf1f2d45 [id=bfa823ee749942f5898a16fa6a064fe6])
I20260812 19:27:33.362784 9735 tablet_loader.cc:96] loaded metadata for tablet e0a53a91dc9e41d58ee4f6a083ca204c (table default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3])
I20260812 19:27:33.379287 9735 tablet_loader.cc:96] loaded metadata for tablet e67867b6cb864b47ba7b115e12cddb17 (table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e])
I20260812 19:27:33.393195 9735 tablet_loader.cc:96] loaded metadata for tablet e9815f0f40634d83a6c6a33b2ab198df (table default.Table_5286b447ea52443c84d86022710997bc [id=74900250511b43f88349feed817b332d])
I20260812 19:27:33.394317 9735 tablet_loader.cc:96] loaded metadata for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35])
I20260812 19:27:33.395354 9735 tablet_loader.cc:96] loaded metadata for tablet eaaf04a85946447aa43873e3568aa3a3 (table default.Table_565297bf6a384bfb86c95a16c2f98f4e [id=9b1730bdd60e490cadcc3292926e6f96])
W20260812 19:27:33.351944 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 69382us
I20260812 19:27:33.396414 9735 tablet_loader.cc:96] loaded metadata for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef])
I20260812 19:27:33.402714 8176 raft_consensus.cc:3037] T fbff8d38116d4af9ba9497f65e876827 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.405462 9735 tablet_loader.cc:96] loaded metadata for tablet f093c8ebbcae4d33918a3c9f30eabb5a (table default.Table_1ffdf4360f8748df9e45c5b04dc093e5 [id=e2abe957f6434f35a9da50378bd4aa35])
I20260812 19:27:33.407752 9735 tablet_loader.cc:96] loaded metadata for tablet f41e6528b71e4d35a6aee94bb7dd7a57 (table default.Table_0c169ee9078f4bed9f0e3611083f1540 [id=fb2cc5bfeacf477fb0455ef2c27cd2be])
I20260812 19:27:33.360111 8623 tablet_bootstrap.cc:654] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:33.409497 9735 tablet_loader.cc:96] loaded metadata for tablet f6f3a2193f2744249de635be4f949889 (table default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 [id=74a2d08bc0c84a5588100bf04f828cf2])
I20260812 19:27:33.410563 9735 tablet_loader.cc:96] loaded metadata for tablet f7c9e6328b70417cbeecf31f318f9b61 (table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735])
I20260812 19:27:33.411598 9735 tablet_loader.cc:96] loaded metadata for tablet f9aa94ea25c04790902a3a4d0c0099ad (table default.Table_a059cc3e3a9345ddbd2e7c031966470f [id=a095e4d6dde54adfbd59686c9e67d995])
W20260812 19:27:33.187356 8281 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 76163.5us
I20260812 19:27:33.416980 8627 tablet_bootstrap.cc:700] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7: Time spent opening tablet: real 0.289s user 0.004s sys 0.000s
I20260812 19:27:33.417685 8627 tablet_bootstrap.cc:654] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:33.420989 9735 tablet_loader.cc:96] loaded metadata for tablet fac74fcb73d1489f8542496293d6141c (table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d])
I20260812 19:27:33.423719 9735 tablet_loader.cc:96] loaded metadata for tablet fbff8d38116d4af9ba9497f65e876827 (table default.Table_916f8c0b79394ffc9e296b898a1f93ec [id=9d6691884d174daba49818fe5d1529ac])
W20260812 19:27:33.449885 9735 catalog_manager.cc:1476] Time spent T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Loading table and tablet metadata into memory: real 19.976s user 0.374s sys 0.099s
I20260812 19:27:33.450265 9735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:27:33.480748 7968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:33.482857 7968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 15) took 17112 ms (client timeout 630 ms). Trace:
I20260812 19:27:33.490828 10476 consensus_queue.cc:1035] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:33.493417 7966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:33.495622 7966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 7) took 15978 ms (client timeout 711 ms). Trace:
I20260812 19:27:33.497871 7965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:33.500557 7963 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:33.451329 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:33.502187 7971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:33.504992 7971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 14) took 18813 ms (client timeout 618 ms). Trace:
W20260812 19:27:33.505429 7971 rpcz_store.cc:269] 0812 19:27:14.691340 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:14.691583 (+ 243us) service_pool.cc:227] Handling call
0812 19:27:33.504869 (+18813286us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:33.454183 7970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:33.509399 7970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 5) took 18463 ms (client timeout 737 ms). Trace:
W20260812 19:27:33.510061 7970 rpcz_store.cc:269] 0812 19:27:15.046362 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:15.048250 (+ 1888us) service_pool.cc:227] Handling call
0812 19:27:33.509275 (+18461025us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:33.512007 7953 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:46888 (request call id 283) took 20028 ms. Trace:
I20260812 19:27:33.455585 7969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:33.516886 7969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 6) took 17549 ms (client timeout 737 ms). Trace:
W20260812 19:27:33.517648 7969 rpcz_store.cc:269] 0812 19:27:15.967064 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:15.967292 (+ 228us) service_pool.cc:227] Handling call
0812 19:27:33.516752 (+17549460us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.519474 7969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 11) took 13471 ms (client timeout 528 ms). Trace:
I20260812 19:27:33.506858 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 4 candidate_status { last_received { term: 3 index: 320 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:33.521497 7964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:51394 (request call id 10) took 15262 ms. Trace:
W20260812 19:27:33.526083 7963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 17) took 14938 ms (client timeout 667 ms). Trace:
I20260812 19:27:33.513976 7953 rpcz_store.cc:276] 0812 19:27:13.482949 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:13.483095 (+ 146us) service_pool.cc:227] Handling call
0812 19:27:33.507376 (+20024281us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.531651 7972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 13) took 19514 ms (client timeout 618 ms). Trace:
W20260812 19:27:33.547397 7965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 8) took 15313 ms (client timeout 711 ms). Trace:
W20260812 19:27:33.549834 7965 rpcz_store.cc:269] 0812 19:27:18.234180 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:18.234425 (+ 245us) service_pool.cc:227] Handling call
0812 19:27:33.545062 (+15310637us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.553514 7967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 16) took 16441 ms (client timeout 630 ms). Trace:
W20260812 19:27:33.554279 7967 rpcz_store.cc:269] 0812 19:27:17.112370 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:17.112636 (+ 266us) service_pool.cc:227] Handling call
0812 19:27:33.553334 (+16440698us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.556308 7967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 20) took 11754 ms (client timeout 604 ms). Trace:
W20260812 19:27:33.557127 8446 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 92953.1us
W20260812 19:27:33.548836 7972 rpcz_store.cc:269] 0812 19:27:14.017288 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:14.017446 (+ 158us) service_pool.cc:227] Handling call
0812 19:27:33.531185 (+19513739us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:33.559607 7964 rpcz_store.cc:276] 0812 19:27:18.251375 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:18.251543 (+ 168us) service_pool.cc:227] Handling call
0812 19:27:33.513630 (+15262087us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.546150 7963 rpcz_store.cc:269] 0812 19:27:18.587150 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:18.587424 (+ 274us) service_pool.cc:227] Handling call
0812 19:27:33.525928 (+14938504us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.562178 7971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 12) took 12949 ms (client timeout 528 ms). Trace:
W20260812 19:27:33.563791 7971 rpcz_store.cc:269] 0812 19:27:20.612806 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.561833 (+12949027us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.562109 (+ 276us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.498742 7968 rpcz_store.cc:269] 0812 19:27:16.370366 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:16.370549 (+ 183us) service_pool.cc:227] Handling call
0812 19:27:33.482662 (+17112113us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.567140 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 48915.8us
I20260812 19:27:33.571208 8623 tablet_bootstrap.cc:492] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:33.571591 8623 ts_tablet_manager.cc:1397] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.545s user 0.009s sys 0.024s
W20260812 19:27:33.496587 7966 rpcz_store.cc:269] 0812 19:27:17.516871 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:17.517059 (+ 188us) service_pool.cc:227] Handling call
0812 19:27:33.495411 (+15978352us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:33.573469 7972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 13) took 11366 ms (client timeout 692 ms). Trace:
W20260812 19:27:33.573918 7972 rpcz_store.cc:269] 0812 19:27:22.207368 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.573232 (+11365864us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.573410 (+ 178us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:33.575335 8623 raft_consensus.cc:348] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.576126 8623 raft_consensus.cc:374] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:33.587502 8623 raft_consensus.cc:729] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:33.588238 8623 consensus_queue.cc:260] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.589967 8623 ts_tablet_manager.cc:1428] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.018s user 0.000s sys 0.006s
I20260812 19:27:33.590965 8623 tablet_bootstrap.cc:492] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:33.594805 7963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 15) took 10725 ms (client timeout 692 ms). Trace:
W20260812 19:27:33.595249 7963 rpcz_store.cc:269] 0812 19:27:22.869038 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.594535 (+10725497us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.594706 (+ 171us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.596136 7963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 16) took 10529 ms (client timeout 693 ms). Trace:
W20260812 19:27:33.596527 7963 rpcz_store.cc:269] 0812 19:27:23.066805 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.595968 (+10529163us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.596087 (+ 119us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:33.596962 8623 tablet_bootstrap.cc:654] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
W20260812 19:27:33.597440 7963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 17) took 8654 ms (client timeout 683 ms). Trace:
W20260812 19:27:33.597815 7963 rpcz_store.cc:269] 0812 19:27:24.943289 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.597275 (+8653986us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.597391 (+ 116us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:33.598388 8627 tablet_bootstrap.cc:492] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:33.598829 8627 ts_tablet_manager.cc:1397] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.483s user 0.012s sys 0.004s
I20260812 19:27:33.599858 10192 raft_consensus.cc:482] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:33.600471 8849 master_runner.cc:232] Existing masters have differing terms: 3 vs 5
I20260812 19:27:33.600274 10192 raft_consensus.cc:504] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.601054 8849 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:27:33.601965 10192 leader_election.cc:288] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
W20260812 19:27:33.584244 7970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 18) took 14215 ms (client timeout 667 ms). Trace:
W20260812 19:27:33.607671 7970 rpcz_store.cc:269] 0812 19:27:19.347704 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.512989 (+14165285us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.549436 (+ 36447us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.598748 7965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 19) took 12418 ms (client timeout 604 ms). Trace:
W20260812 19:27:33.608443 7965 rpcz_store.cc:269] 0812 19:27:21.180753 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.562752 (+12381999us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.598689 (+ 35937us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.609337 7965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 19) took 5335 ms (client timeout 630 ms). Trace:
W20260812 19:27:33.609543 8281 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 74481.1us
W20260812 19:27:33.609722 7965 rpcz_store.cc:269] 0812 19:27:28.274470 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.609173 (+5334703us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.609287 (+ 114us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.610585 7965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 20) took 4683 ms (client timeout 630 ms). Trace:
W20260812 19:27:33.610978 7965 rpcz_store.cc:269] 0812 19:27:28.926981 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.610451 (+4683470us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.610543 (+ 92us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.611773 7965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 23) took 4530 ms (client timeout 598 ms). Trace:
W20260812 19:27:33.612138 7965 rpcz_store.cc:269] 0812 19:27:29.081070 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.611622 (+4530552us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.611728 (+ 106us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:33.615254 8278 leader_election.cc:302] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:27:33.616843 7965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 25) took 1872 ms (client timeout 654 ms). Trace:
I20260812 19:27:33.617430 10523 raft_consensus.cc:2781] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
W20260812 19:27:33.604207 7966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 18) took 7715 ms (client timeout 683 ms). Trace:
I20260812 19:27:33.617924 10523 raft_consensus.cc:686] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
W20260812 19:27:33.543905 7969 rpcz_store.cc:269] 0812 19:27:20.048244 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.519067 (+13470823us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.519346 (+ 279us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:33.604655 9735 catalog_manager.cc:1259] Loaded cluster ID: 659155adda434886ba3c3e41d37f31b5
W20260812 19:27:33.618818 7969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 26) took 1181 ms (client timeout 654 ms). Trace:
I20260812 19:27:33.619056 9735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:27:33.618719 10523 consensus_queue.cc:237] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:33.619185 7969 rpcz_store.cc:269] 0812 19:27:32.437106 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.618634 (+1181528us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.618762 (+ 128us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.620211 7969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 23) took 978 ms (client timeout 653 ms). Trace:
W20260812 19:27:33.620601 7969 rpcz_store.cc:269] 0812 19:27:32.642017 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.620069 (+978052us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.620162 (+ 93us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:33.621616 7969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:33.606423 7971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 14) took 11234 ms (client timeout 693 ms). Trace:
W20260812 19:27:33.622699 7971 rpcz_store.cc:269] 0812 19:27:22.371650 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.591314 (+11219664us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.606355 (+ 15041us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.612938 7970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 24) took 3911 ms (client timeout 598 ms). Trace:
I20260812 19:27:33.623098 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
W20260812 19:27:33.623418 7970 rpcz_store.cc:269] 0812 19:27:29.701245 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.612775 (+3911530us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.612881 (+ 106us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.602579 7964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 21) took 8394 ms (client timeout 598 ms). Trace:
W20260812 19:27:33.624100 7964 rpcz_store.cc:269] 0812 19:27:25.208080 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.599375 (+8391295us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.602498 (+ 3123us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.617978 7966 rpcz_store.cc:269] 0812 19:27:25.888568 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.604042 (+7715474us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.604157 (+ 115us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.613610 7963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 21) took 3363 ms (client timeout 746 ms). Trace:
I20260812 19:27:33.625128 10572 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 19:27:33.625145 7963 rpcz_store.cc:269] 0812 19:27:30.250489 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.613453 (+3362964us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.613554 (+ 101us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.616153 7972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 22) took 2576 ms (client timeout 746 ms). Trace:
W20260812 19:27:33.625830 7972 rpcz_store.cc:269] 0812 19:27:31.039345 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.616017 (+2576672us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.616102 (+ 85us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.603403 7968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 22) took 7725 ms (client timeout 598 ms). Trace:
W20260812 19:27:33.626471 7968 rpcz_store.cc:269] 0812 19:27:25.878138 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.603221 (+7725083us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.603352 (+ 131us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.563176 7967 rpcz_store.cc:269] 0812 19:27:21.801614 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.555833 (+11754219us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.556183 (+ 350us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260812 19:27:33.627902 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:33.628599 8510 raft_consensus.cc:2379] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
W20260812 19:27:33.627280 7965 rpcz_store.cc:269] 0812 19:27:31.743997 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.616700 (+1872703us) service_pool.cc:214] Skipping call since client already timed out
0812 19:27:33.616795 (+ 95us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260812 19:27:33.642300 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 205773us
I20260812 19:27:33.693186 8623 tablet_bootstrap.cc:492] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:33.693602 8623 ts_tablet_manager.cc:1397] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.103s user 0.025s sys 0.008s
I20260812 19:27:33.695824 8623 raft_consensus.cc:348] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.696619 8623 raft_consensus.cc:374] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:33.696959 8623 raft_consensus.cc:729] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:33.702571 8623 consensus_queue.cc:260] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:33.703702 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 60302.2us
I20260812 19:27:33.721101 8623 ts_tablet_manager.cc:1428] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.027s user 0.006s sys 0.001s
I20260812 19:27:33.734328 9735 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:27:33.804227 8623 tablet_bootstrap.cc:492] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:33.616299 8278 leader_election.cc:302] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
W20260812 19:27:33.811658 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 195439us
I20260812 19:27:33.812758 10526 raft_consensus.cc:2781] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:33.814495 8623 tablet_bootstrap.cc:654] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:33.814920 10526 raft_consensus.cc:686] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:33.816272 10526 consensus_queue.cc:237] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.820222 9735 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Loaded TSK: 0
I20260812 19:27:33.833750 9735 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:27:33.843116 8627 raft_consensus.cc:348] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.843979 8627 raft_consensus.cc:374] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:33.844308 8627 raft_consensus.cc:729] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:33.844962 8627 consensus_queue.cc:260] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.856088 8623 tablet_bootstrap.cc:492] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:33.856539 8623 ts_tablet_manager.cc:1397] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.053s user 0.009s sys 0.013s
I20260812 19:27:33.862110 10502 raft_consensus.cc:482] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:33.862584 10502 raft_consensus.cc:504] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.863034 8171 raft_consensus.cc:3037] T f9aa94ea25c04790902a3a4d0c0099ad P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.865363 10502 leader_election.cc:288] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
W20260812 19:27:33.895820 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 49232us
I20260812 19:27:33.895656 8623 raft_consensus.cc:348] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.896690 8623 raft_consensus.cc:374] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:33.897099 8623 raft_consensus.cc:729] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:33.902200 8623 consensus_queue.cc:260] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:33.849329 8278 leader_election.cc:302] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:33.904397 10523 raft_consensus.cc:2781] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:33.905169 10523 raft_consensus.cc:686] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:33.906852 8623 ts_tablet_manager.cc:1428] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.047s user 0.006s sys 0.000s
I20260812 19:27:33.907152 10523 consensus_queue.cc:237] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:33.910768 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 61524.4us
I20260812 19:27:33.915841 8278 leader_election.cc:302] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:33.916633 10549 raft_consensus.cc:2781] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:33.917084 10549 raft_consensus.cc:482] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:33.917454 10549 raft_consensus.cc:3037] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:33.932505 9735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:27:33.967015 8627 ts_tablet_manager.cc:1428] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.368s user 0.008s sys 0.000s
I20260812 19:27:33.991122 8623 tablet_bootstrap.cc:492] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:34.012450 10579 log.cc:924] Time spent T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7: Append to log took a long time: real 0.119s user 0.016s sys 0.006s
I20260812 19:27:34.012972 8623 tablet_bootstrap.cc:654] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:33.985292 10549 raft_consensus.cc:504] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.075089 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:34.075722 8179 raft_consensus.cc:2454] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:34.091787 8446 leader_election.cc:302] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:34.098039 10501 raft_consensus.cc:2781] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:34.098510 10501 raft_consensus.cc:482] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:34.098291 8623 tablet_bootstrap.cc:492] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:34.099045 10501 raft_consensus.cc:3037] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.099318 8623 ts_tablet_manager.cc:1397] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.108s user 0.016s sys 0.021s
I20260812 19:27:34.102708 8623 raft_consensus.cc:348] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.103349 8623 raft_consensus.cc:374] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:34.103574 8623 raft_consensus.cc:729] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:34.104329 8623 consensus_queue.cc:260] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.106106 8623 ts_tablet_manager.cc:1428] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20260812 19:27:34.111739 10501 raft_consensus.cc:504] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:34.127535 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 177658us
I20260812 19:27:34.136891 8278 leader_election.cc:302] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:34.146880 8623 tablet_bootstrap.cc:492] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:34.152642 8623 tablet_bootstrap.cc:654] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:34.156842 10476 raft_consensus.cc:2781] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:34.164898 10549 leader_election.cc:288] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.172824 10501 leader_election.cc:288] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.174105 8623 tablet_bootstrap.cc:492] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:34.174523 8623 ts_tablet_manager.cc:1397] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.002s
I20260812 19:27:34.176741 8623 raft_consensus.cc:348] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.177515 8623 raft_consensus.cc:374] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:34.177752 8623 raft_consensus.cc:729] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:34.178602 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:34.179612 8179 raft_consensus.cc:3037] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.179715 8171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:34.178391 8623 consensus_queue.cc:260] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.176651 10523 consensus_queue.cc:1035] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260812 19:27:34.184140 8623 ts_tablet_manager.cc:1428] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20260812 19:27:34.187029 8179 raft_consensus.cc:2454] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:34.189031 8446 leader_election.cc:302] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:34.190006 10565 raft_consensus.cc:2781] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:34.190438 10565 raft_consensus.cc:686] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:34.191223 10565 consensus_queue.cc:237] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
W20260812 19:27:34.194057 8281 leader_election.cc:341] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:34.215394 8623 tablet_bootstrap.cc:492] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
W20260812 19:27:34.244513 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 104394us
I20260812 19:27:34.247371 8623 tablet_bootstrap.cc:654] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:34.250288 10484 raft_consensus.cc:482] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:34.250757 10484 raft_consensus.cc:504] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.254140 10484 leader_election.cc:288] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:34.256021 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:34.257058 8510 raft_consensus.cc:2379] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:34.276989 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]
I20260812 19:27:34.289708 8623 tablet_bootstrap.cc:492] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:34.290205 8623 ts_tablet_manager.cc:1397] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.075s user 0.007s sys 0.005s
I20260812 19:27:34.292449 8623 raft_consensus.cc:348] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.293109 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]
I20260812 19:27:34.317636 8623 raft_consensus.cc:374] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:34.318013 8623 raft_consensus.cc:729] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:34.322566 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3]
I20260812 19:27:34.318677 8623 consensus_queue.cc:260] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.325234 8623 ts_tablet_manager.cc:1428] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20260812 19:27:34.326236 8623 tablet_bootstrap.cc:492] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:34.328852 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]
I20260812 19:27:34.332922 8623 tablet_bootstrap.cc:654] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:34.338784 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825]
I20260812 19:27:34.360757 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:34.363652 8350 raft_consensus.cc:2379] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:34.332548 10476 raft_consensus.cc:686] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:34.369159 10476 consensus_queue.cc:237] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.376722 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:34.395839 8353 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7c258a18b8da47aabafd67023d3e5812" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:34.405673 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6]
I20260812 19:27:34.415843 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050]
I20260812 19:27:34.441540 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]
I20260812 19:27:34.464215 10192 raft_consensus.cc:482] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:34.464742 10192 raft_consensus.cc:504] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.465200 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:34.465739 8516 raft_consensus.cc:3037] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.466640 10192 leader_election.cc:288] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:34.467309 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc0601e681ba426991b22b6a7303ae2c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:34.467957 8510 raft_consensus.cc:2379] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:34.471634 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685]
I20260812 19:27:34.473516 8516 raft_consensus.cc:2454] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:34.487529 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07]
I20260812 19:27:34.492439 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b]
I20260812 19:27:34.493600 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb]
I20260812 19:27:34.494801 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]
I20260812 19:27:34.495967 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]
I20260812 19:27:34.508195 10476 raft_consensus.cc:482] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:34.508410 10523 raft_consensus.cc:482] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:34.508737 10476 raft_consensus.cc:504] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.508976 10523 raft_consensus.cc:504] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.510728 10476 leader_election.cc:288] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.510851 10523 leader_election.cc:288] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.526444 8352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:34.527055 8352 raft_consensus.cc:2454] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
W20260812 19:27:34.536379 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 60353.5us
I20260812 19:27:34.542807 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:34.543383 8350 raft_consensus.cc:3037] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.548346 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569]
I20260812 19:27:34.556649 8350 raft_consensus.cc:2454] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:34.572394 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:34.573908 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:34.574477 8511 raft_consensus.cc:2454] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:34.574930 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc]
I20260812 19:27:34.577771 10484 raft_consensus.cc:482] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:34.578285 10484 raft_consensus.cc:504] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.580488 10484 leader_election.cc:288] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:34.580595 8171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30c274273c3496cb0a8b8650b504250" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:34.581588 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:34.582257 8510 raft_consensus.cc:2379] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:34.583220 8171 raft_consensus.cc:2379] T d30c274273c3496cb0a8b8650b504250 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:34.584291 8171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
W20260812 19:27:34.589347 8281 leader_election.cc:341] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:27:34.595530 8623 tablet_bootstrap.cc:492] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:34.599417 8623 ts_tablet_manager.cc:1397] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.273s user 0.028s sys 0.066s
I20260812 19:27:34.599004 8108 leader_election.cc:302] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:34.601675 10484 raft_consensus.cc:3037] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.576102 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]
I20260812 19:27:34.624904 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cc0601e681ba426991b22b6a7303ae2c" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:34.626783 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790]
I20260812 19:27:34.628954 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]
I20260812 19:27:34.625280 8623 raft_consensus.cc:348] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.647864 8171 raft_consensus.cc:3037] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.649735 8623 raft_consensus.cc:374] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:34.650007 8623 raft_consensus.cc:729] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:34.653755 8623 consensus_queue.cc:260] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.658882 10484 raft_consensus.cc:2726] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:34.656229 8278 leader_election.cc:302] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:34.658243 10589 consensus_queue.cc:1035] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260812 19:27:34.666707 10523 raft_consensus.cc:2781] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:34.667172 10523 raft_consensus.cc:686] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:34.667950 10523 consensus_queue.cc:237] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.670313 8108 leader_election.cc:302] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:34.684644 8108 leader_election.cc:302] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:34.685425 10595 raft_consensus.cc:3037] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.692879 10595 raft_consensus.cc:2726] T 7c258a18b8da47aabafd67023d3e5812 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:34.694322 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033]
I20260812 19:27:34.700554 10476 consensus_queue.cc:1035] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:34.702883 8278 leader_election.cc:302] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:34.703742 10588 raft_consensus.cc:2781] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:34.704053 10588 raft_consensus.cc:482] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:34.704391 10588 raft_consensus.cc:3037] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.707702 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369]
I20260812 19:27:34.709586 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a]
I20260812 19:27:34.720193 8623 ts_tablet_manager.cc:1428] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.121s user 0.007s sys 0.000s
I20260812 19:27:34.721303 8623 tablet_bootstrap.cc:492] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380: Bootstrap starting.
I20260812 19:27:34.731050 8278 leader_election.cc:302] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 93aafc5b36824666a82aa55bc73df9e7; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:34.733610 10192 raft_consensus.cc:2726] T 7a530a6bcdb04b268c7a3f4becb065e2 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:34.735072 10589 raft_consensus.cc:2726] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:34.716148 10588 raft_consensus.cc:504] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.757328 10588 leader_election.cc:288] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.758512 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
W20260812 19:27:34.760077 8281 leader_election.cc:341] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Illegal state: must be running to vote when last-logged opid is not known
W20260812 19:27:34.761981 8108 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 77403.8us
I20260812 19:27:34.764021 8108 leader_election.cc:302] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:34.764642 10192 raft_consensus.cc:3037] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.770834 10476 raft_consensus.cc:482] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:34.771298 10476 raft_consensus.cc:504] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.773171 10476 leader_election.cc:288] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.775022 8182 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:34.775794 8182 raft_consensus.cc:2454] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:34.777000 8281 leader_election.cc:302] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:34.778041 10589 raft_consensus.cc:2781] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:34.778389 10589 raft_consensus.cc:482] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:34.778709 10589 raft_consensus.cc:3037] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.779299 10604 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:34.781406 10192 raft_consensus.cc:2726] T cc0601e681ba426991b22b6a7303ae2c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:34.781967 10604 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:34.799075 8623 tablet_bootstrap.cc:654] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:34.807762 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:34.808511 8511 raft_consensus.cc:3037] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.828716 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:34.834569 10583 consensus_queue.cc:1035] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:34.835216 10599 raft_consensus.cc:482] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:34.835799 10599 raft_consensus.cc:504] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.839691 10599 leader_election.cc:288] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.842722 10604 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:34.845908 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4]
I20260812 19:27:34.860877 8510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:34.861264 10549 consensus_queue.cc:1035] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:34.861526 8510 raft_consensus.cc:2454] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:34.862920 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:34.864148 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c881ad61438d4a978e3c479aefcfa4cb" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:34.873957 8623 tablet_bootstrap.cc:492] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380: No bootstrap required, opened a new log
I20260812 19:27:34.874370 8623 ts_tablet_manager.cc:1397] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380: Time spent bootstrapping tablet: real 0.153s user 0.005s sys 0.004s
W20260812 19:27:34.874864 10603 log.cc:924] Time spent T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.062s user 0.000s sys 0.000s
I20260812 19:27:34.889480 8623 raft_consensus.cc:348] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.890161 8623 raft_consensus.cc:374] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:34.890444 8623 raft_consensus.cc:729] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6a95b50ceede4dc99913aec28ddaa380, State: Initialized, Role: FOLLOWER
I20260812 19:27:34.890975 8623 consensus_queue.cc:260] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.892643 8623 ts_tablet_manager.cc:1428] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20260812 19:27:34.788139 10589 raft_consensus.cc:504] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.894865 8350 raft_consensus.cc:2379] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:34.896229 10589 leader_election.cc:288] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029)
I20260812 19:27:34.897722 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067]
I20260812 19:27:34.898169 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:34.898702 8176 raft_consensus.cc:3037] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.899060 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8]
I20260812 19:27:34.899452 8511 raft_consensus.cc:2454] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:34.900857 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:34.908905 8176 raft_consensus.cc:2454] T aff8c4a6f27c499eb555d97017cb3a4c P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:34.909886 8281 leader_election.cc:302] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:34.910660 10583 raft_consensus.cc:2781] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:34.911092 10583 raft_consensus.cc:686] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:34.911890 10583 consensus_queue.cc:237] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:34.921319 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e]
I20260812 19:27:34.928526 8108 leader_election.cc:302] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:34.929227 10484 raft_consensus.cc:3037] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.968779 8443 leader_election.cc:302] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:34.969766 10599 raft_consensus.cc:3037] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:34.970504 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:34.939973 10484 raft_consensus.cc:2726] T c881ad61438d4a978e3c479aefcfa4cb P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:34.980913 10599 raft_consensus.cc:2726] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:35.005153 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f]
I20260812 19:27:35.006814 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]
I20260812 19:27:35.012670 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_abc701c69d604e08b2c81f972eeeb6e8 [id=6ad4b3f784244d538e0836d507969cdc]
I20260812 19:27:35.018565 8278 leader_election.cc:302] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters: 6a95b50ceede4dc99913aec28ddaa380
I20260812 19:27:35.019438 10583 raft_consensus.cc:2781] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:27:35.020027 10583 raft_consensus.cc:686] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Becoming Leader. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Running, Role: LEADER
I20260812 19:27:35.021263 10549 consensus_queue.cc:1035] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:35.021270 10583 consensus_queue.cc:237] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:35.052505 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47]
I20260812 19:27:35.063586 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2]
I20260812 19:27:35.064874 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_5286b447ea52443c84d86022710997bc [id=74900250511b43f88349feed817b332d]
I20260812 19:27:35.065995 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 [id=74a2d08bc0c84a5588100bf04f828cf2]
I20260812 19:27:35.067116 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_61a721fd804b43e280c455210e7cabd8 [id=74c19f2de82344a69c7314ac3012fb9f]
I20260812 19:27:35.069990 10501 raft_consensus.cc:482] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:35.070423 10501 raft_consensus.cc:504] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:35.074684 8179 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380" is_pre_election: true
I20260812 19:27:35.075263 8179 raft_consensus.cc:2454] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
W20260812 19:27:35.076395 8107 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 100801us
I20260812 19:27:35.076511 8446 leader_election.cc:302] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:35.077198 10565 raft_consensus.cc:2781] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:27:35.077512 10565 raft_consensus.cc:482] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:35.077818 10565 raft_consensus.cc:3037] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:35.079047 10589 consensus_queue.cc:1035] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:35.086903 10565 raft_consensus.cc:504] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:35.087723 10501 leader_election.cc:288] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:35.089985 8176 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6a95b50ceede4dc99913aec28ddaa380"
I20260812 19:27:35.090509 8176 raft_consensus.cc:3037] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:35.101038 8176 raft_consensus.cc:2454] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 2.
I20260812 19:27:35.101307 8511 raft_consensus.cc:2454] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 1.
I20260812 19:27:35.102106 8446 leader_election.cc:302] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 6a95b50ceede4dc99913aec28ddaa380; no voters:
I20260812 19:27:35.103380 10599 raft_consensus.cc:2781] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:27:35.105136 10599 raft_consensus.cc:686] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 LEADER]: Becoming Leader. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Running, Role: LEADER
I20260812 19:27:35.106601 10599 consensus_queue.cc:237] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:35.121276 10565 leader_election.cc:288] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:35.148811 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:35.149513 8347 raft_consensus.cc:2454] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 1.
I20260812 19:27:35.173274 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_848e8c259ba3498d9a99ca7a371c2e2d [id=7aef5ac0f0b24593a0c78e7d3864eb09]
I20260812 19:27:35.183423 10616 raft_consensus.cc:482] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:35.184137 10616 raft_consensus.cc:504] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:35.190205 10616 leader_election.cc:288] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:35.200685 8347 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b689d49a1244c7fb12ba84853f2da9d" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:35.201592 8347 raft_consensus.cc:3037] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:27:35.192394 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:35.215114 8511 raft_consensus.cc:2379] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:35.221273 10616 raft_consensus.cc:482] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:35.222813 10616 raft_consensus.cc:504] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } }
I20260812 19:27:35.230691 8516 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:35.231417 8516 raft_consensus.cc:2379] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6a95b50ceede4dc99913aec28ddaa380 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:35.242039 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e]
I20260812 19:27:35.280850 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_d919a6bee2304ccab308b3d08e5be52c [id=82b4d20f40ab43c990959b458f3b11e4]
I20260812 19:27:35.289898 10616 leader_election.cc:288] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:35.301522 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f4fba6ed708046e48420257d6693f0c3 [id=8963896ef496485ba2eff5e329a70150]
I20260812 19:27:35.324183 10565 consensus_queue.cc:1035] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:35.327193 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_72d530bd566d4fa889dd5304f5700a9f [id=8a03ad9f190045adb9f8a0c32c53ab7e]
I20260812 19:27:35.334147 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b35d6b9c90d24b21890d1b174ae92bdb [id=8c765506f69741cb85ac43172fc40548]
I20260812 19:27:35.336629 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]
I20260812 19:27:35.352927 8347 raft_consensus.cc:2454] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 2.
I20260812 19:27:35.377738 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89298e977bef4f519f68446bf75d0df9" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:35.384636 8350 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0df3401001074c62883da06902530399" candidate_uuid: "6a95b50ceede4dc99913aec28ddaa380" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
W20260812 19:27:35.385614 7781 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.556s (SENT) [suppressed 1 similar messages]
I20260812 19:27:35.409862 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_495da693476b4874bb497da7998bf531 [id=937c9f4b3b8546d6958017575c2ca587]
I20260812 19:27:35.411882 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_bcd87c04648c489e9d444bbc8470ccd7 [id=95e83940f5bc4baeba825114eadde1a5]
I20260812 19:27:35.427269 8108 leader_election.cc:302] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:35.428866 10597 raft_consensus.cc:3037] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:35.429359 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701]
I20260812 19:27:35.430662 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]
I20260812 19:27:35.431833 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_1068c7ccc7344a52934df17a65628581 [id=98f3d7d36ae249acac9dfe885cd2484e]
I20260812 19:27:35.446508 8108 leader_election.cc:302] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6a95b50ceede4dc99913aec28ddaa380; no voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:35.447784 10616 raft_consensus.cc:3037] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:35.457455 10616 raft_consensus.cc:2726] T 0df3401001074c62883da06902530399 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:35.470920 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_565297bf6a384bfb86c95a16c2f98f4e [id=9b1730bdd60e490cadcc3292926e6f96]
I20260812 19:27:35.500178 10597 raft_consensus.cc:2726] T 89298e977bef4f519f68446bf75d0df9 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:27:35.509788 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_711ff99c0d184bbd8214b29510d407cc [id=9b70345d8fa242b886b0fcf6433af593]
I20260812 19:27:35.513597 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec]
I20260812 19:27:35.515518 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_916f8c0b79394ffc9e296b898a1f93ec [id=9d6691884d174daba49818fe5d1529ac]
I20260812 19:27:35.568722 10630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:35.569471 10630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:35.583904 7802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:35.592774 10630 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
W20260812 19:27:35.596527 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 45576.6us
I20260812 19:27:35.614974 10635 raft_consensus.cc:482] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 93aafc5b36824666a82aa55bc73df9e7)
I20260812 19:27:35.616166 10635 raft_consensus.cc:504] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
I20260812 19:27:35.619462 10635 leader_election.cc:288] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:35.628683 10526 consensus_queue.cc:1035] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:35.629928 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35]
I20260812 19:27:35.631218 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_87cb1dcf475941269e6d752d00e0df9b [id=9e80dff3c6904e2eb80288a122698ec7]
I20260812 19:27:35.648766 10501 consensus_queue.cc:1035] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:35.660840 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_a059cc3e3a9345ddbd2e7c031966470f [id=a095e4d6dde54adfbd59686c9e67d995]
I20260812 19:27:35.679961 10526 consensus_queue.cc:1035] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:35.687553 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 90040.9us
I20260812 19:27:35.710983 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f429f2bd365a4d5fa9bd32e3d490473b [id=a7e6cd0f83cc491cb3f68098aab6dbab]
I20260812 19:27:35.722244 10583 consensus_queue.cc:1035] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:35.712206 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4]
I20260812 19:27:35.729605 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_c4c3334f5a0b4458b574b4398a96f702 [id=ab7a42f74d6646a7a5fc1f6e0484ab95]
I20260812 19:27:35.730787 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_c5c2449187eb429faa8378da84b0adad [id=ad18f22ffe3f4fa58ed87253a5c6080e]
I20260812 19:27:35.731917 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_51762252a63548a9bf108b1eed133662 [id=af0b194d7f274839bc613a16526ce7a3]
I20260812 19:27:35.741552 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d]
I20260812 19:27:35.742678 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893]
I20260812 19:27:35.743896 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_e3b24459b2554cd3883378cdf0a9fb61 [id=bb604741b9c044d082ffa9daf4fe8d74]
W20260812 19:27:35.784425 8443 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.194:44609, user_credentials={real_user=slave}} blocked reactor thread for 78069.2us
W20260812 19:27:35.840809 8443 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:35.847716 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_3edb2611b0cb4de78624e0ffdf32222c [id=bb9e313afbcf4be9a295e94b16bbecc3]
I20260812 19:27:35.850016 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b8f8f3637e9344998414afa9cf1f2d45 [id=bfa823ee749942f5898a16fa6a064fe6]
W20260812 19:27:35.918231 8281 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.193:46029, user_credentials={real_user=slave}} blocked reactor thread for 130459us
W20260812 19:27:35.948686 7781 leader_election.cc:334] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.556s (SENT)
I20260812 19:27:35.949123 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:35.974265 10661 raft_consensus.cc:2726] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:27:35.852104 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b]
I20260812 19:27:36.027613 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_4b45622c6d97488f977a6ef6b04ac74e [id=c625aebe1cfc488cb159c2796db94108]
I20260812 19:27:36.030633 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_bbda5db214af4795b1d794c0bfa3b278 [id=c8606c010ad14f069ef54b863a2010e3]
I20260812 19:27:36.080626 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]
I20260812 19:27:36.081928 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_02dbea084f02412db88eb169e6bb5cf7 [id=d797b2d682e04058b7e8645792516973]
I20260812 19:27:36.084034 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_65e0e363703e439ea5476db643057688 [id=d7a96e113ac74e29bb7f9be4d43d7fa8]
I20260812 19:27:36.085203 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c]
I20260812 19:27:36.086339 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277]
I20260812 19:27:36.098412 10589 consensus_queue.cc:1035] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:27:36.118546 9360 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.525s (SENT) [suppressed 2 similar messages]
I20260812 19:27:36.124109 10651 consensus_queue.cc:1035] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:36.126178 10654 consensus_queue.cc:1035] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:36.127532 10650 consensus_queue.cc:1035] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:27:36.141358 10650 consensus_queue.cc:1035] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:27:36.146090 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_1ffdf4360f8748df9e45c5b04dc093e5 [id=e2abe957f6434f35a9da50378bd4aa35]
I20260812 19:27:36.149080 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]
I20260812 19:27:36.150259 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_fac2d883e0444e638b031f6bd0209b93 [id=e878f91b7f3749eb9acd213ea6e31430]
I20260812 19:27:36.151424 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_c1665280164645aeaa0ada50bf7e6629 [id=ea7ebd72106345978b7ccd28e8599c2b]
I20260812 19:27:36.166311 8356 raft_consensus.cc:1261] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 [term 2 FOLLOWER]: Refusing update from remote peer 4f26a5f8e5934d8d8c026a2d957c78a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:27:36.167598 10634 consensus_queue.cc:1035] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:27:36.174767 8446 leader_election.cc:341] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 249da5c0bd73498bbfc8f41e7513a9d4
I20260812 19:27:36.175187 8446 leader_election.cc:302] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:36.176095 10631 raft_consensus.cc:2726] T 249da5c0bd73498bbfc8f41e7513a9d4 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:27:36.186561 9360 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 68040.7us
I20260812 19:27:36.229341 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d]
I20260812 19:27:36.230609 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_b25383bb16404fac95cc1d79e20e1185 [id=ed6829a78ccb41109d1f99403f38ddb3]
I20260812 19:27:36.261880 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318]
I20260812 19:27:36.277316 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca]
I20260812 19:27:36.292549 8171 raft_consensus.cc:1261] T 7b689d49a1244c7fb12ba84853f2da9d P 6a95b50ceede4dc99913aec28ddaa380 [term 2 FOLLOWER]: Refusing update from remote peer 4f26a5f8e5934d8d8c026a2d957c78a5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260812 19:27:36.287083 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_7bbd6b066d084c81b9307f7db324d95f [id=f832c3b9d1784bb1b4794513d4832db8]
I20260812 19:27:36.329456 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_0c169ee9078f4bed9f0e3611083f1540 [id=fb2cc5bfeacf477fb0455ef2c27cd2be]
I20260812 19:27:36.331945 9735 catalog_manager.cc:669] Loaded metadata for table default.Table_4ba940c06806406eb455a26f9e2c0917 [id=fe03d45525a94b4d8980f8b96e14c696]
I20260812 19:27:36.413657 10634 consensus_queue.cc:1035] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260812 19:27:36.413975 8446 consensus_peers.cc:487] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df369d3c4e004c29ac65c5ecf7f8c4cc. This is attempt 11: this message will repeat every 5th retry.
W20260812 19:27:36.429847 10672 log.cc:924] Time spent T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5: Append to log took a long time: real 0.066s user 0.002s sys 0.000s
I20260812 19:27:36.584172 9735 tablet_loader.cc:96] loaded metadata for tablet 01063b51cc35482c918f74b43fa3ee8f (table default.Table_e3b24459b2554cd3883378cdf0a9fb61 [id=bb604741b9c044d082ffa9daf4fe8d74])
I20260812 19:27:36.646989 9735 tablet_loader.cc:96] loaded metadata for tablet 05b8e6cecfa04aa685014277c15fb6f4 (table default.Table_fac2d883e0444e638b031f6bd0209b93 [id=e878f91b7f3749eb9acd213ea6e31430])
I20260812 19:27:36.685015 9735 tablet_loader.cc:96] loaded metadata for tablet 067fdfc16a7e44c2b3dac5fe262a5728 (table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce])
W20260812 19:27:36.680471 8446 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.144.252:46815, user_credentials={real_user=slave}} blocked reactor thread for 45891.1us
I20260812 19:27:36.686306 9735 tablet_loader.cc:96] loaded metadata for tablet 0df3401001074c62883da06902530399 (table default.Table_4ba940c06806406eb455a26f9e2c0917 [id=fe03d45525a94b4d8980f8b96e14c696])
I20260812 19:27:36.687520 9735 tablet_loader.cc:96] loaded metadata for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44])
I20260812 19:27:36.693334 9735 tablet_loader.cc:96] loaded metadata for tablet 11eb974d35ba42418292e5a9fa82e331 (table default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07])
I20260812 19:27:36.695459 9735 tablet_loader.cc:96] loaded metadata for tablet 13607c1893434a728d989eb1c8c88eea (table default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033])
W20260812 19:27:36.719760 9360 leader_election.cc:334] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815): Timed out: RequestConsensusVote RPC to 127.7.144.252:46815 timed out after 0.525s (SENT)
I20260812 19:27:36.720518 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:36.719489 9735 tablet_loader.cc:96] loaded metadata for tablet 140266bae6254efe9b87d0f8e3bfaa4e (table default.Table_51762252a63548a9bf108b1eed133662 [id=af0b194d7f274839bc613a16526ce7a3])
I20260812 19:27:36.735467 9735 tablet_loader.cc:96] loaded metadata for tablet 1950030ab501429a91971f80f761a172 (table default.Table_0c23725418434d109d96642b5fe3b47b [id=db8857e0e25649529098af75aa5ea277])
I20260812 19:27:36.737893 9735 tablet_loader.cc:96] loaded metadata for tablet 2175811e6a7646c3ae82daaa8c626bca (table default.Table_65e0e363703e439ea5476db643057688 [id=d7a96e113ac74e29bb7f9be4d43d7fa8])
I20260812 19:27:36.745247 10679 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:27:36.770834 9735 tablet_loader.cc:96] loaded metadata for tablet 29436abddcab4a46adb5aa0c54f45389 (table default.Table_c5c2449187eb429faa8378da84b0adad [id=ad18f22ffe3f4fa58ed87253a5c6080e])
I20260812 19:27:36.813701 9735 tablet_loader.cc:96] loaded metadata for tablet 30940fe1277e4347941f3525f6448cdb (table default.Table_e72885fe051d48ee9af557340be9798b [id=f80317e4a2554875bc9f6918092af5ca])
I20260812 19:27:36.814845 9735 tablet_loader.cc:96] loaded metadata for tablet 311b68f298164090bc9458e3ee16f6cb (table default.Table_3edb2611b0cb4de78624e0ffdf32222c [id=bb9e313afbcf4be9a295e94b16bbecc3])
I20260812 19:27:36.815935 9735 tablet_loader.cc:96] loaded metadata for tablet 33591e906f0e433d98e07e424ea0b07f (table default.Table_c4c3334f5a0b4458b574b4398a96f702 [id=ab7a42f74d6646a7a5fc1f6e0484ab95])
I20260812 19:27:36.817008 9735 tablet_loader.cc:96] loaded metadata for tablet 336e05589e784e768695439e7dc93b71 (table default.Table_f429f2bd365a4d5fa9bd32e3d490473b [id=a7e6cd0f83cc491cb3f68098aab6dbab])
I20260812 19:27:36.818753 9735 tablet_loader.cc:96] loaded metadata for tablet 354d9912acad4c1ba76f45ce277f1e94 (table default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0])
I20260812 19:27:36.819802 9735 tablet_loader.cc:96] loaded metadata for tablet 355b9f4f5ada428789aa871c888843e1 (table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569])
I20260812 19:27:36.868372 9735 tablet_loader.cc:96] loaded metadata for tablet 538d05c5883d4575b8eb5d42dfb3c246 (table default.Table_aa5a653ce4b2458d9075328b363afb4b [id=d8d745230100465d86d0374a29aabd7c])
I20260812 19:27:36.870174 9735 tablet_loader.cc:96] loaded metadata for tablet 5717f521074d49c6baec431f0d739c91 (table default.Table_61a721fd804b43e280c455210e7cabd8 [id=74c19f2de82344a69c7314ac3012fb9f])
I20260812 19:27:36.873446 9735 tablet_loader.cc:96] loaded metadata for tablet 5db9e00d07964bde9f769e217236a771 (table default.Table_02dbea084f02412db88eb169e6bb5cf7 [id=d797b2d682e04058b7e8645792516973])
I20260812 19:27:36.874558 9735 tablet_loader.cc:96] loaded metadata for tablet 5f3c6d8f74d044948a893d756be9a838 (table default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f])
I20260812 19:27:36.877134 9735 tablet_loader.cc:96] loaded metadata for tablet 61fce7b5a9d84718a1ed252f9f5f91d9 (table default.Table_45bab0149eb241b59b363bf986003fee [id=ed0a6de9012a40f182525359155bfe9d])
I20260812 19:27:36.878222 9735 tablet_loader.cc:96] loaded metadata for tablet 622deb66eead473189ab85a53cb8c81f (table default.Table_87cb1dcf475941269e6d752d00e0df9b [id=9e80dff3c6904e2eb80288a122698ec7])
I20260812 19:27:36.879945 9735 tablet_loader.cc:96] loaded metadata for tablet 663d0d16b9cd4bed9bb5529b514f9e30 (table default.Table_f4fba6ed708046e48420257d6693f0c3 [id=8963896ef496485ba2eff5e329a70150])
I20260812 19:27:36.883059 9735 tablet_loader.cc:96] loaded metadata for tablet 6aa599b75d9e4f10b2cbed69b9b9c92b (table default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb])
I20260812 19:27:36.884123 9735 tablet_loader.cc:96] loaded metadata for tablet 6b32b8e857c04567a2a751c379a05440 (table default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6])
I20260812 19:27:36.887236 9735 tablet_loader.cc:96] loaded metadata for tablet 6ff5b2d23d734217b0b10e50834b8883 (table default.Table_48972fc8f09a42bcb9ce2505d2c93896 [id=b77e2eb3773a4dc9b7dd8c4ad6b1d893])
I20260812 19:27:36.890465 9735 tablet_loader.cc:96] loaded metadata for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8])
I20260812 19:27:36.891575 9735 tablet_loader.cc:96] loaded metadata for tablet 787047cca4ce4c6884ce5bd07a93f077 (table default.Table_abc701c69d604e08b2c81f972eeeb6e8 [id=6ad4b3f784244d538e0836d507969cdc])
I20260812 19:27:36.892715 9735 tablet_loader.cc:96] loaded metadata for tablet 7a530a6bcdb04b268c7a3f4becb065e2 (table default.Table_bcd87c04648c489e9d444bbc8470ccd7 [id=95e83940f5bc4baeba825114eadde1a5])
I20260812 19:27:36.893757 9735 tablet_loader.cc:96] loaded metadata for tablet 7b689d49a1244c7fb12ba84853f2da9d (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe])
I20260812 19:27:36.894817 9735 tablet_loader.cc:96] loaded metadata for tablet 7c258a18b8da47aabafd67023d3e5812 (table default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47])
I20260812 19:27:36.897311 9735 tablet_loader.cc:96] loaded metadata for tablet 818eae7a6645415e992c25565f7f3b5a (table default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a])
I20260812 19:27:36.898360 9735 tablet_loader.cc:96] loaded metadata for tablet 841c459584534458977b6182b71c77f1 (table default.Table_bbda5db214af4795b1d794c0bfa3b278 [id=c8606c010ad14f069ef54b863a2010e3])
I20260812 19:27:36.900127 9735 tablet_loader.cc:96] loaded metadata for tablet 867e426fedce4c9895b7b9a13f8bb5e3 (table default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790])
I20260812 19:27:36.901228 9735 tablet_loader.cc:96] loaded metadata for tablet 89298e977bef4f519f68446bf75d0df9 (table default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6])
I20260812 19:27:36.902940 9735 tablet_loader.cc:96] loaded metadata for tablet 8c9d071f07e5410d9e660986ab6858ef (table default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec])
I20260812 19:27:36.903992 9735 tablet_loader.cc:96] loaded metadata for tablet 9293d85d08c34dbeb3f324322f2d656c (table default.Table_848e8c259ba3498d9a99ca7a371c2e2d [id=7aef5ac0f0b24593a0c78e7d3864eb09])
I20260812 19:27:36.905073 9735 tablet_loader.cc:96] loaded metadata for tablet 92d412842c9c4dd0bb47e774d1df8e4b (table default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369])
I20260812 19:27:36.907563 9735 tablet_loader.cc:96] loaded metadata for tablet 95e195a643084486a74be961177bf42c (table default.Table_495da693476b4874bb497da7998bf531 [id=937c9f4b3b8546d6958017575c2ca587])
I20260812 19:27:36.908632 9735 tablet_loader.cc:96] loaded metadata for tablet 96839764810f4b7e9b3dd7a64be85dd1 (table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0])
I20260812 19:27:36.909701 9735 tablet_loader.cc:96] loaded metadata for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701])
I20260812 19:27:36.910719 9735 tablet_loader.cc:96] loaded metadata for tablet 9b5e92063f494c79be75371f2626b1e3 (table default.Table_4b45622c6d97488f977a6ef6b04ac74e [id=c625aebe1cfc488cb159c2796db94108])
I20260812 19:27:36.911725 9735 tablet_loader.cc:96] loaded metadata for tablet 9bdb7cce923c4ed98e400c121b6237ba (table default.Table_c1665280164645aeaa0ada50bf7e6629 [id=ea7ebd72106345978b7ccd28e8599c2b])
I20260812 19:27:36.912770 9735 tablet_loader.cc:96] loaded metadata for tablet 9be4dabb7fa042bd8fa6b45fa63e8674 (table default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4])
I20260812 19:27:36.913782 9735 tablet_loader.cc:96] loaded metadata for tablet 9f0afa2f3cee483facfbb2712917b829 (table default.Table_1068c7ccc7344a52934df17a65628581 [id=98f3d7d36ae249acac9dfe885cd2484e])
I20260812 19:27:36.914813 9735 tablet_loader.cc:96] loaded metadata for tablet a06d3ff29cc14599bce1531a7b63f072 (table default.Table_72d530bd566d4fa889dd5304f5700a9f [id=8a03ad9f190045adb9f8a0c32c53ab7e])
I20260812 19:27:36.917207 9735 tablet_loader.cc:96] loaded metadata for tablet a2b4ef63a53540e6be590243b1d27330 (table default.Table_7bbd6b066d084c81b9307f7db324d95f [id=f832c3b9d1784bb1b4794513d4832db8])
I20260812 19:27:36.920585 9735 tablet_loader.cc:96] loaded metadata for tablet a91c4d5adb3d4f97939e38e9cee79532 (table default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285])
I20260812 19:27:36.929217 9735 tablet_loader.cc:96] loaded metadata for tablet aff8c4a6f27c499eb555d97017cb3a4c (table default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2])
I20260812 19:27:36.930343 9735 tablet_loader.cc:96] loaded metadata for tablet b00a037a2567470497e1a751754df345 (table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067])
I20260812 19:27:36.931495 9735 tablet_loader.cc:96] loaded metadata for tablet b07f7215876740519164e7d7e08302bd (table default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970])
I20260812 19:27:36.934388 9735 tablet_loader.cc:96] loaded metadata for tablet b31c1afb090041d7b6ae35a846772b1d (table default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4])
I20260812 19:27:36.935972 9735 tablet_loader.cc:96] loaded metadata for tablet b4d07516dc1c4193b4cbd68185f92891 (table default.Table_990df3b957234fec971d2f5184745c9e [id=c1176fb24c264bc8ba83616685d7ce1b])
I20260812 19:27:36.941146 9735 tablet_loader.cc:96] loaded metadata for tablet b51a28468ba74a8e88d0936dc3281eca (table default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685])
I20260812 19:27:36.943006 9735 tablet_loader.cc:96] loaded metadata for tablet b7d4a12b9c14415e8449d39663296450 (table default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e])
I20260812 19:27:36.954200 9735 tablet_loader.cc:96] loaded metadata for tablet bc8ae6adf7b64a468112753c2831ac87 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be])
I20260812 19:27:36.957062 9735 tablet_loader.cc:96] loaded metadata for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc])
I20260812 19:27:36.958177 9735 tablet_loader.cc:96] loaded metadata for tablet c607886a76344185aa9af5da797b9ae8 (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6])
I20260812 19:27:36.959232 9735 tablet_loader.cc:96] loaded metadata for tablet c67135f8c5ae422485bca11ada90afaa (table default.Table_d919a6bee2304ccab308b3d08e5be52c [id=82b4d20f40ab43c990959b458f3b11e4])
I20260812 19:27:36.960319 9735 tablet_loader.cc:96] loaded metadata for tablet c881ad61438d4a978e3c479aefcfa4cb (table default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825])
I20260812 19:27:36.962093 9735 tablet_loader.cc:96] loaded metadata for tablet cc0601e681ba426991b22b6a7303ae2c (table default.Table_b25383bb16404fac95cc1d79e20e1185 [id=ed6829a78ccb41109d1f99403f38ddb3])
I20260812 19:27:36.963053 9735 tablet_loader.cc:96] loaded metadata for tablet cdb6ba8b98474fff97ae3f45218870f0 (table default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318])
I20260812 19:27:36.965441 9735 tablet_loader.cc:96] loaded metadata for tablet d30c274273c3496cb0a8b8650b504250 (table default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b])
I20260812 19:27:36.967211 9735 tablet_loader.cc:96] loaded metadata for tablet d49351be8d2a40109d88b54db11c4489 (table default.Table_b35d6b9c90d24b21890d1b174ae92bdb [id=8c765506f69741cb85ac43172fc40548])
I20260812 19:27:36.968209 9735 tablet_loader.cc:96] loaded metadata for tablet d4d4e8d3d6ef40058b29f7cc574a5565 (table default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050])
I20260812 19:27:36.989583 9735 tablet_loader.cc:96] loaded metadata for tablet d8f522d072cc4ae0a4cc98f1bb88fbc6 (table default.Table_711ff99c0d184bbd8214b29510d407cc [id=9b70345d8fa242b886b0fcf6433af593])
I20260812 19:27:37.002218 9735 tablet_loader.cc:96] loaded metadata for tablet e03513e6d6bc4e7ba5dfc355ccc0cb0f (table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0])
I20260812 19:27:37.003340 9735 tablet_loader.cc:96] loaded metadata for tablet e0451c2d5d6b4851a83ee9d30aa40a6c (table default.Table_b8f8f3637e9344998414afa9cf1f2d45 [id=bfa823ee749942f5898a16fa6a064fe6])
I20260812 19:27:37.004427 9735 tablet_loader.cc:96] loaded metadata for tablet e0a53a91dc9e41d58ee4f6a083ca204c (table default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3])
I20260812 19:27:37.009735 9735 tablet_loader.cc:96] loaded metadata for tablet e67867b6cb864b47ba7b115e12cddb17 (table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e])
I20260812 19:27:37.011447 9735 tablet_loader.cc:96] loaded metadata for tablet e9815f0f40634d83a6c6a33b2ab198df (table default.Table_5286b447ea52443c84d86022710997bc [id=74900250511b43f88349feed817b332d])
I20260812 19:27:37.012506 9735 tablet_loader.cc:96] loaded metadata for tablet e98e0f5b053649f1a5ab315312b37442 (table default.Table_811a3f46c44d4369b3e3cc69871e2db5 [id=9e19d1c4060746faa8cc2da99fd6ed35])
I20260812 19:27:37.013530 9735 tablet_loader.cc:96] loaded metadata for tablet eaaf04a85946447aa43873e3568aa3a3 (table default.Table_565297bf6a384bfb86c95a16c2f98f4e [id=9b1730bdd60e490cadcc3292926e6f96])
I20260812 19:27:37.014554 9735 tablet_loader.cc:96] loaded metadata for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef])
I20260812 19:27:37.034679 9735 tablet_loader.cc:96] loaded metadata for tablet f093c8ebbcae4d33918a3c9f30eabb5a (table default.Table_1ffdf4360f8748df9e45c5b04dc093e5 [id=e2abe957f6434f35a9da50378bd4aa35])
I20260812 19:27:37.046554 9735 tablet_loader.cc:96] loaded metadata for tablet f41e6528b71e4d35a6aee94bb7dd7a57 (table default.Table_0c169ee9078f4bed9f0e3611083f1540 [id=fb2cc5bfeacf477fb0455ef2c27cd2be])
I20260812 19:27:37.048436 9735 tablet_loader.cc:96] loaded metadata for tablet f6f3a2193f2744249de635be4f949889 (table default.Table_33d1abe4f7ee45e4a2d97cc132d24e07 [id=74a2d08bc0c84a5588100bf04f828cf2])
I20260812 19:27:37.049489 9735 tablet_loader.cc:96] loaded metadata for tablet f7c9e6328b70417cbeecf31f318f9b61 (table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735])
I20260812 19:27:37.050563 9735 tablet_loader.cc:96] loaded metadata for tablet f9aa94ea25c04790902a3a4d0c0099ad (table default.Table_a059cc3e3a9345ddbd2e7c031966470f [id=a095e4d6dde54adfbd59686c9e67d995])
I20260812 19:27:37.051604 9735 tablet_loader.cc:96] loaded metadata for tablet fac74fcb73d1489f8542496293d6141c (table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d])
I20260812 19:27:37.064620 9735 tablet_loader.cc:96] loaded metadata for tablet fbff8d38116d4af9ba9497f65e876827 (table default.Table_916f8c0b79394ffc9e296b898a1f93ec [id=9d6691884d174daba49818fe5d1529ac])
I20260812 19:27:37.103000 10501 raft_consensus.cc:482] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6a95b50ceede4dc99913aec28ddaa380)
I20260812 19:27:37.103543 10501 raft_consensus.cc:504] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } }
W20260812 19:27:37.109359 9735 catalog_manager.cc:1476] Time spent T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Loading table and tablet metadata into memory: real 3.176s user 0.366s sys 0.010s
I20260812 19:27:37.109619 9735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:27:37.115499 7953 rpcz_store.cc:275] Call kudu.master.MasterService.ConnectToMaster from 127.0.0.1:46888 (request call id 295) took 3160 ms. Trace:
I20260812 19:27:37.115849 7953 rpcz_store.cc:276] 0812 19:27:33.954941 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:33.955122 (+ 181us) service_pool.cc:227] Handling call
0812 19:27:37.115431 (+3160309us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:37.116628 7965 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:37.117453 7965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 27) took 2289 ms (client timeout 556 ms). Trace:
W20260812 19:27:37.117802 7965 rpcz_store.cc:269] 0812 19:27:34.827951 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:34.828073 (+ 122us) service_pool.cc:227] Handling call
0812 19:27:37.117385 (+2289312us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:37.118817 7967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:37.119544 7967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57918 (request call id 28) took 1726 ms (client timeout 556 ms). Trace:
W20260812 19:27:37.119853 7967 rpcz_store.cc:269] 0812 19:27:35.393389 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:35.393515 (+ 126us) service_pool.cc:227] Handling call
0812 19:27:37.119486 (+1725971us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:37.120791 7968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:37.121618 7968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 25) took 1529 ms (client timeout 525 ms). Trace:
W20260812 19:27:37.123562 7968 rpcz_store.cc:269] 0812 19:27:35.591867 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:35.591985 (+ 118us) service_pool.cc:227] Handling call
0812 19:27:37.121561 (+1529576us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:27:37.127179 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 321 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
W20260812 19:27:37.127983 7972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51394 (request call id 26) took 935 ms (client timeout 525 ms). Trace:
W20260812 19:27:37.128322 7972 rpcz_store.cc:269] 0812 19:27:36.192748 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:36.192866 (+ 118us) service_pool.cc:227] Handling call
0812 19:27:37.127924 (+935058us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260812 19:27:37.136822 8446 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:37.134009 10501 leader_election.cc:288] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:37.190395 9735 catalog_manager.cc:1259] Loaded cluster ID: 659155adda434886ba3c3e41d37f31b5
I20260812 19:27:37.190708 9735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:27:37.237130 9735 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:27:37.267500 9735 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Loaded TSK: 0
I20260812 19:27:37.268654 9735 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:27:37.323110 7959 master_service.cc:946] ReplaceTablet: received request to replace tablet 354d9912acad4c1ba76f45ce277f1e94 from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:37.325481 7960 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:46888:
table { table_name: "default.Table_abc701c69d604e08b2c81f972eeeb6e8" } new_table_name: "default.Table_0c4a4663fba54b6a828c70d1b50a0f36" modify_external_catalogs: true
I20260812 19:27:37.324970 7954 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_ea1246ee662c4855bf7e6d1d12cdeeb5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:37.327394 7954 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_ea1246ee662c4855bf7e6d1d12cdeeb5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:37.327721 7962 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_f1a3995068804c0f8e952189333316f2"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:37.329164 7962 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_f1a3995068804c0f8e952189333316f2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:37.332121 7957 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_8694d6c643034217b788691682ac90da"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:37.333532 7957 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_8694d6c643034217b788691682ac90da in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:37.348186 7956 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46888:
name: "default.Table_b5476874c6234d7ba3b6222a6e57f480"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:27:37.349679 7956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.Table_b5476874c6234d7ba3b6222a6e57f480 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:27:37.383751 7953 master_service.cc:946] ReplaceTablet: received request to replace tablet 8c9d071f07e5410d9e660986ab6858ef from {username='slave'} at 127.0.0.1:46888
I20260812 19:27:37.492379 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet df369d3c4e004c29ac65c5ecf7f8c4cc with delete_type TABLET_DATA_DELETED (replaced by tablet c607886a76344185aa9af5da797b9ae8) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:37.518877 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 2b04529031f04302846b39d585d74ad5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 19:27:00 UTC) from {username='slave'} at 127.0.0.1:44394
W20260812 19:27:37.530797 8443 leader_election.cc:341] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): Not found: Tablet not found: 3740799e07f94fe981d395ef8c3d7973
I20260812 19:27:37.531126 8567 heartbeater.cc:503] Master 127.7.144.252:46815 was elected leader, sending a full tablet report...
I20260812 19:27:37.531309 8443 leader_election.cc:302] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
I20260812 19:27:37.532397 10501 raft_consensus.cc:2726] T 3740799e07f94fe981d395ef8c3d7973 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 19:27:37.534111 8409 heartbeater.cc:503] Master 127.7.144.252:46815 was elected leader, sending a full tablet report...
I20260812 19:27:37.547637 10693 tablet_replica.cc:330] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:37.529172 10689 tablet_replica.cc:330] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:37.584772 10689 raft_consensus.cc:2229] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:37.586081 10689 raft_consensus.cc:2258] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:37.597173 10689 ts_tablet_manager.cc:1905] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:37.695031 10693 raft_consensus.cc:2229] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 2 LEADER]: Raft consensus shutting down.
I20260812 19:27:37.716123 7959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 354d9912acad4c1ba76f45ce277f1e94
I20260812 19:27:37.717903 7959 catalog_manager.cc:6565] ReplaceTablet: tablet 354d9912acad4c1ba76f45ce277f1e94 deleted and replaced by tablet ef2be8ad851b4f4a9ac2f00632a660b9
I20260812 19:27:37.720327 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet 354d9912acad4c1ba76f45ce277f1e94 with delete_type TABLET_DATA_DELETED (replaced by tablet ef2be8ad851b4f4a9ac2f00632a660b9) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:37.721678 8153 tablet_service.cc:1514] Processing DeleteTablet for tablet 354d9912acad4c1ba76f45ce277f1e94 with delete_type TABLET_DATA_DELETED (replaced by tablet ef2be8ad851b4f4a9ac2f00632a660b9) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:37.735911 10693 raft_consensus.cc:2258] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260812 19:27:37.736238 8278 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.195:33171, user_credentials={real_user=slave}} blocked reactor thread for 55040.2us
I20260812 19:27:37.738271 10693 ts_tablet_manager.cc:1905] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:37.741276 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 354d9912acad4c1ba76f45ce277f1e94 with delete_type TABLET_DATA_DELETED (replaced by tablet ef2be8ad851b4f4a9ac2f00632a660b9) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:37.749938 10701 tablet_replica.cc:330] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380: stopping tablet replica
I20260812 19:27:37.758399 10701 raft_consensus.cc:2229] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:37.758755 10693 ts_tablet_manager.cc:1918] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.2
I20260812 19:27:37.767494 10693 log.cc:1196] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/2b04529031f04302846b39d585d74ad5
I20260812 19:27:37.769188 10693 ts_tablet_manager.cc:1939] T 2b04529031f04302846b39d585d74ad5 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:37.770119 10701 raft_consensus.cc:2258] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:37.774557 10689 ts_tablet_manager.cc:1918] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:37.775195 10689 log.cc:1196] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/df369d3c4e004c29ac65c5ecf7f8c4cc
I20260812 19:27:37.776726 10689 ts_tablet_manager.cc:1939] T df369d3c4e004c29ac65c5ecf7f8c4cc P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:37.782900 10693 tablet_replica.cc:330] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:37.785212 10693 raft_consensus.cc:2229] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:37.790844 10693 raft_consensus.cc:2258] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:37.794368 10693 ts_tablet_manager.cc:1905] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:37.785818 10701 ts_tablet_manager.cc:1905] T 354d9912acad4c1ba76f45ce277f1e94 P 6a95b50ceede4dc99913aec28ddaa380: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:37.814114 10689 tablet_replica.cc:330] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:37.814873 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 2b04529031f04302846b39d585d74ad5 (table default.Table_2c80f7680532421eba6c258b2820ae59 [id=43c68f9d1c484e8e8ae9c431c099d551]) successfully deleted
I20260812 19:27:37.830986 10689 raft_consensus.cc:2229] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:37.833704 10689 raft_consensus.cc:2258] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:37.855726 10689 ts_tablet_manager.cc:1905] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:27:37.907925 7945 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.253:41563, user_credentials={real_user=slave}} blocked reactor thread for 91823.6us
I20260812 19:27:37.913141 7747 master-stress-test.cc:580] Killed test thread 1/10
I20260812 19:27:37.913820 7747 master-stress-test.cc:578] Killing test thread 2/10
I20260812 19:27:37.914376 7747 master-stress-test.cc:580] Killed test thread 2/10
I20260812 19:27:37.914649 7747 master-stress-test.cc:578] Killing test thread 3/10
I20260812 19:27:37.914973 7747 master-stress-test.cc:580] Killed test thread 3/10
I20260812 19:27:37.915236 7747 master-stress-test.cc:578] Killing test thread 4/10
I20260812 19:27:37.915525 7747 master-stress-test.cc:580] Killed test thread 4/10
I20260812 19:27:37.915784 7747 master-stress-test.cc:578] Killing test thread 5/10
I20260812 19:27:37.916090 7747 master-stress-test.cc:580] Killed test thread 5/10
I20260812 19:27:37.916333 7747 master-stress-test.cc:578] Killing test thread 6/10
I20260812 19:27:37.918622 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet df369d3c4e004c29ac65c5ecf7f8c4cc (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]) successfully deleted
I20260812 19:27:38.003710 7953 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6: Sending DeleteTablet for 3 replicas of tablet 8c9d071f07e5410d9e660986ab6858ef
W20260812 19:27:38.004134 7960 catalog_manager.cc:5755] Failed to send alter table request: Not found: failed to reset TS proxy: No leader found: Tablet 787047cca4ce4c6884ce5bd07a93f077 consensus state has no leader
I20260812 19:27:38.005571 8486 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c9d071f07e5410d9e660986ab6858ef with delete_type TABLET_DATA_DELETED (replaced by tablet f6a25467bcdf42b2add6fb9ffa73b285) from {username='slave'} at 127.0.0.1:44966
I20260812 19:27:38.005893 8326 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c9d071f07e5410d9e660986ab6858ef with delete_type TABLET_DATA_DELETED (replaced by tablet f6a25467bcdf42b2add6fb9ffa73b285) from {username='slave'} at 127.0.0.1:44394
I20260812 19:27:38.007054 7953 catalog_manager.cc:6565] ReplaceTablet: tablet 8c9d071f07e5410d9e660986ab6858ef deleted and replaced by tablet f6a25467bcdf42b2add6fb9ffa73b285
I20260812 19:27:38.011270 8153 tablet_service.cc:1514] Processing DeleteTablet for tablet 8c9d071f07e5410d9e660986ab6858ef with delete_type TABLET_DATA_DELETED (replaced by tablet f6a25467bcdf42b2add6fb9ffa73b285) from {username='slave'} at 127.0.0.1:33126
I20260812 19:27:38.012270 7747 master-stress-test.cc:580] Killed test thread 6/10
I20260812 19:27:38.012507 7747 master-stress-test.cc:578] Killing test thread 7/10
I20260812 19:27:38.012844 7747 master-stress-test.cc:580] Killed test thread 7/10
I20260812 19:27:38.013046 7747 master-stress-test.cc:578] Killing test thread 8/10
I20260812 19:27:38.013370 7747 master-stress-test.cc:580] Killed test thread 8/10
I20260812 19:27:38.013584 7747 master-stress-test.cc:578] Killing test thread 9/10
I20260812 19:27:38.014030 7747 master-stress-test.cc:580] Killed test thread 9/10
I20260812 19:27:38.014259 7747 master-stress-test.cc:578] Killing test thread 10/10
I20260812 19:27:38.019008 10689 ts_tablet_manager.cc:1918] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:38.019341 7747 master-stress-test.cc:580] Killed test thread 10/10
I20260812 19:27:38.019383 10693 ts_tablet_manager.cc:1918] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:38.019737 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 8053
I20260812 19:27:38.019819 10693 log.cc:1196] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/354d9912acad4c1ba76f45ce277f1e94
I20260812 19:27:38.028949 10693 ts_tablet_manager.cc:1939] T 354d9912acad4c1ba76f45ce277f1e94 P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
W20260812 19:27:38.030934 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 787047cca4ce4c6884ce5bd07a93f077 (table default.Table_0c4a4663fba54b6a828c70d1b50a0f36 [id=6ad4b3f784244d538e0836d507969cdc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 787047cca4ce4c6884ce5bd07a93f077 consensus state has no leader
I20260812 19:27:38.039175 10693 tablet_replica.cc:330] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: stopping tablet replica
I20260812 19:27:38.039513 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 354d9912acad4c1ba76f45ce277f1e94 (table default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]) successfully deleted
I20260812 19:27:38.040089 10693 raft_consensus.cc:2229] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:27:38.042271 10693 raft_consensus.cc:2258] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:38.044667 10693 ts_tablet_manager.cc:1905] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:38.054351 10689 log.cc:1196] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/354d9912acad4c1ba76f45ce277f1e94
I20260812 19:27:38.055190 10689 ts_tablet_manager.cc:1939] T 354d9912acad4c1ba76f45ce277f1e94 P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:38.069685 10689 tablet_replica.cc:330] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: stopping tablet replica
I20260812 19:27:38.069864 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 354d9912acad4c1ba76f45ce277f1e94 (table default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]) successfully deleted
I20260812 19:27:38.070706 10689 raft_consensus.cc:2229] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:27:38.074170 10689 raft_consensus.cc:2258] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:27:38.117204 10689 ts_tablet_manager.cc:1905] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:27:38.128786 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 41903177f1d14b8b8605f90318d7ba95 (DEFAULT_TABLE table=default.Table_8694d6c643034217b788691682ac90da [id=a3fe7b36fa504805a287af8bcd8ae2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.129191 8326 tablet_service.cc:1467] Processing CreateTablet for tablet 41903177f1d14b8b8605f90318d7ba95 (DEFAULT_TABLE table=default.Table_8694d6c643034217b788691682ac90da [id=a3fe7b36fa504805a287af8bcd8ae2e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.130119 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41903177f1d14b8b8605f90318d7ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.130487 8326 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 41903177f1d14b8b8605f90318d7ba95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.133080 8329 tablet_service.cc:1467] Processing CreateTablet for tablet 055ec64bd8374073b8fbe90ba0d7dbfe (DEFAULT_TABLE table=default.Table_ea1246ee662c4855bf7e6d1d12cdeeb5 [id=31e33e46389e40ee8d8af26f39df9ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.134032 8329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055ec64bd8374073b8fbe90ba0d7dbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.137176 8493 tablet_service.cc:1467] Processing CreateTablet for tablet 055ec64bd8374073b8fbe90ba0d7dbfe (DEFAULT_TABLE table=default.Table_ea1246ee662c4855bf7e6d1d12cdeeb5 [id=31e33e46389e40ee8d8af26f39df9ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.138242 8493 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 055ec64bd8374073b8fbe90ba0d7dbfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.157135 8333 tablet_service.cc:1467] Processing CreateTablet for tablet cdb6ba8b98474fff97ae3f45218870f0 (DEFAULT_TABLE table=default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.158226 8333 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb6ba8b98474fff97ae3f45218870f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.170331 8325 tablet_service.cc:1467] Processing CreateTablet for tablet d06a742cc4864679a56bf88d2568f2b8 (DEFAULT_TABLE table=default.Table_b5476874c6234d7ba3b6222a6e57f480 [id=16219c11f94e4916a050298fa66fe05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.171566 10693 ts_tablet_manager.cc:1918] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:38.171597 8325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d06a742cc4864679a56bf88d2568f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.172032 10693 log.cc:1196] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/8c9d071f07e5410d9e660986ab6858ef
I20260812 19:27:38.179595 10693 ts_tablet_manager.cc:1939] T 8c9d071f07e5410d9e660986ab6858ef P 93aafc5b36824666a82aa55bc73df9e7: Deleting consensus metadata
I20260812 19:27:38.182433 7946 catalog_manager.cc:4841] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609): tablet 8c9d071f07e5410d9e660986ab6858ef (table default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec]) successfully deleted
I20260812 19:27:38.199672 8322 tablet_service.cc:1467] Processing CreateTablet for tablet 16685b218abf46bc87c90f3601a02438 (DEFAULT_TABLE table=default.Table_f1a3995068804c0f8e952189333316f2 [id=62db093581394968bfbb7b08df201cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.200904 8322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16685b218abf46bc87c90f3601a02438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.218602 10707 tablet_bootstrap.cc:492] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:38.230506 8479 tablet_service.cc:1467] Processing CreateTablet for tablet cdb6ba8b98474fff97ae3f45218870f0 (DEFAULT_TABLE table=default.Table_78b8216abc99490ba45598cd4f0a6588 [id=f7b19839176e40aebe3b4d33078df318]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.231637 8479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdb6ba8b98474fff97ae3f45218870f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.234321 8485 tablet_service.cc:1467] Processing CreateTablet for tablet d06a742cc4864679a56bf88d2568f2b8 (DEFAULT_TABLE table=default.Table_b5476874c6234d7ba3b6222a6e57f480 [id=16219c11f94e4916a050298fa66fe05d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.236052 8485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d06a742cc4864679a56bf88d2568f2b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.244249 10707 tablet_bootstrap.cc:654] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.257254 8328 tablet_service.cc:1467] Processing CreateTablet for tablet ef2be8ad851b4f4a9ac2f00632a660b9 (DEFAULT_TABLE table=default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.258316 8328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef2be8ad851b4f4a9ac2f00632a660b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.260639 8486 tablet_service.cc:1467] Processing CreateTablet for tablet 16685b218abf46bc87c90f3601a02438 (DEFAULT_TABLE table=default.Table_f1a3995068804c0f8e952189333316f2 [id=62db093581394968bfbb7b08df201cd6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.261734 8486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16685b218abf46bc87c90f3601a02438. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.271023 7956 catalog_manager.cc:5495] T d4d4e8d3d6ef40058b29f7cc574a5565 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.296521 7956 catalog_manager.cc:5495] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.305168 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 9be4dabb7fa042bd8fa6b45fa63e8674 (table default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4]). Expected version 1 got 0
I20260812 19:27:38.306273 7956 catalog_manager.cc:5495] T 5717f521074d49c6baec431f0d739c91 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.315110 7956 catalog_manager.cc:5495] T fbff8d38116d4af9ba9497f65e876827 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.319445 10689 ts_tablet_manager.cc:1918] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:27:38.332944 7956 catalog_manager.cc:5495] T b07f7215876740519164e7d7e08302bd P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 2 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.333874 10712 tablet_bootstrap.cc:492] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:38.337615 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet b07f7215876740519164e7d7e08302bd (table default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]). Expected version 1 got 0
I20260812 19:27:38.338356 7956 catalog_manager.cc:5495] T f41e6528b71e4d35a6aee94bb7dd7a57 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.340785 7956 catalog_manager.cc:5495] T e0a53a91dc9e41d58ee4f6a083ca204c P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.354496 7956 catalog_manager.cc:5495] T 9b5e92063f494c79be75371f2626b1e3 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.360872 7956 catalog_manager.cc:5495] T 92d412842c9c4dd0bb47e774d1df8e4b P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.363361 7956 catalog_manager.cc:5495] T c6075b2e46524829962d2b84353013b2 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.364557 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc]). Expected version 2 got 0
I20260812 19:27:38.364646 8481 tablet_service.cc:1467] Processing CreateTablet for tablet ef2be8ad851b4f4a9ac2f00632a660b9 (DEFAULT_TABLE table=default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:27:38.365767 8481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef2be8ad851b4f4a9ac2f00632a660b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:38.365474 7956 catalog_manager.cc:5495] T 7764a1ae009142b29d5fb574dca45e21 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.366705 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8]). Expected version 2 got 0
I20260812 19:27:38.367492 7956 catalog_manager.cc:5495] T 787047cca4ce4c6884ce5bd07a93f077 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.368845 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 787047cca4ce4c6884ce5bd07a93f077 (table default.Table_0c4a4663fba54b6a828c70d1b50a0f36 [id=6ad4b3f784244d538e0836d507969cdc]). Expected version 1 got 0
I20260812 19:27:38.319926 10689 log.cc:1196] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_0.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/8c9d071f07e5410d9e660986ab6858ef
I20260812 19:27:38.377532 10689 ts_tablet_manager.cc:1939] T 8c9d071f07e5410d9e660986ab6858ef P 4f26a5f8e5934d8d8c026a2d957c78a5: Deleting consensus metadata
I20260812 19:27:38.369632 7956 catalog_manager.cc:5495] T c607886a76344185aa9af5da797b9ae8 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.391032 7945 catalog_manager.cc:4841] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171): tablet 8c9d071f07e5410d9e660986ab6858ef (table default.Table_ecc7df46a94f444cbbff889c5e0a639c [id=9cf04a1305884fd686adc5ec52d81aec]) successfully deleted
I20260812 19:27:38.391067 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet c607886a76344185aa9af5da797b9ae8 (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]). Expected version 2 got 0
I20260812 19:27:38.396795 7956 catalog_manager.cc:5495] T c881ad61438d4a978e3c479aefcfa4cb P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.397593 10707 tablet_bootstrap.cc:492] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:38.398106 10707 ts_tablet_manager.cc:1397] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.180s user 0.015s sys 0.004s
I20260812 19:27:38.398641 7956 catalog_manager.cc:5495] T 7b689d49a1244c7fb12ba84853f2da9d P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 2 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:38.399693 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 7b689d49a1244c7fb12ba84853f2da9d (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:38.400643 7956 catalog_manager.cc:5495] T 0fd84e685b2b4e819f4b61e442828b13 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.400902 10707 raft_consensus.cc:348] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.401567 10707 raft_consensus.cc:374] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:38.401644 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]). Expected version 1 got 0
I20260812 19:27:38.401867 10707 raft_consensus.cc:729] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:38.435050 10712 tablet_bootstrap.cc:654] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.423187 10707 consensus_queue.cc:260] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.402277 7956 catalog_manager.cc:5495] T 622deb66eead473189ab85a53cb8c81f P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.456137 10712 tablet_bootstrap.cc:492] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:38.456671 10712 ts_tablet_manager.cc:1397] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.123s user 0.012s sys 0.003s
I20260812 19:27:38.456655 7956 catalog_manager.cc:5495] T f6f3a2193f2744249de635be4f949889 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.458254 7956 catalog_manager.cc:5495] T e67867b6cb864b47ba7b115e12cddb17 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.459213 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet e67867b6cb864b47ba7b115e12cddb17 (table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e]). Expected version 1 got 0
I20260812 19:27:38.459203 10712 raft_consensus.cc:348] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.462121 10707 ts_tablet_manager.cc:1428] T 41903177f1d14b8b8605f90318d7ba95 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.064s user 0.003s sys 0.004s
I20260812 19:27:38.463006 10707 tablet_bootstrap.cc:492] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:38.459851 10712 raft_consensus.cc:374] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:38.469949 10712 raft_consensus.cc:729] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:38.470733 10712 consensus_queue.cc:260] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.459918 7956 catalog_manager.cc:5495] T 9bdb7cce923c4ed98e400c121b6237ba P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.505811 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 9bdb7cce923c4ed98e400c121b6237ba (table default.Table_c1665280164645aeaa0ada50bf7e6629 [id=ea7ebd72106345978b7ccd28e8599c2b]). Expected version 1 got 0
I20260812 19:27:38.506534 7956 catalog_manager.cc:5495] T bc8ae6adf7b64a468112753c2831ac87 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:38.507563 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet bc8ae6adf7b64a468112753c2831ac87 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:27:38.502089 10712 ts_tablet_manager.cc:1428] T ef2be8ad851b4f4a9ac2f00632a660b9 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.045s user 0.005s sys 0.001s
I20260812 19:27:38.508231 7956 catalog_manager.cc:5495] T a2b4ef63a53540e6be590243b1d27330 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.509449 10712 tablet_bootstrap.cc:492] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:38.509407 7956 catalog_manager.cc:5495] T 140266bae6254efe9b87d0f8e3bfaa4e P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.510605 7956 catalog_manager.cc:5495] T 9293d85d08c34dbeb3f324322f2d656c P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.515928 10707 tablet_bootstrap.cc:654] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.516454 10712 tablet_bootstrap.cc:654] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.511788 7956 catalog_manager.cc:5495] T 5db9e00d07964bde9f769e217236a771 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.547173 7956 catalog_manager.cc:5495] T 5f3c6d8f74d044948a893d756be9a838 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.567512 10712 tablet_bootstrap.cc:492] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:38.568231 10712 ts_tablet_manager.cc:1397] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.059s user 0.003s sys 0.010s
I20260812 19:27:38.570937 10712 raft_consensus.cc:348] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.571686 10712 raft_consensus.cc:374] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:38.571986 10712 raft_consensus.cc:729] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:38.573246 10712 consensus_queue.cc:260] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.560026 7956 catalog_manager.cc:5495] T 6ff5b2d23d734217b0b10e50834b8883 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.583899 7956 catalog_manager.cc:5495] T 663d0d16b9cd4bed9bb5529b514f9e30 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.585206 7956 catalog_manager.cc:5495] T a91c4d5adb3d4f97939e38e9cee79532 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.588192 10707 tablet_bootstrap.cc:492] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:38.588632 10707 ts_tablet_manager.cc:1397] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.126s user 0.006s sys 0.007s
I20260812 19:27:38.592309 10712 ts_tablet_manager.cc:1428] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.024s user 0.001s sys 0.006s
I20260812 19:27:38.593701 10712 tablet_bootstrap.cc:492] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:38.597925 10707 raft_consensus.cc:348] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.599948 10707 raft_consensus.cc:374] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:38.602834 10707 raft_consensus.cc:729] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:38.603169 10712 tablet_bootstrap.cc:654] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.601943 7956 catalog_manager.cc:5495] T c67135f8c5ae422485bca11ada90afaa P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.604611 10707 consensus_queue.cc:260] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.610610 10676 raft_consensus.cc:482] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:38.610992 10676 raft_consensus.cc:504] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.611673 10654 raft_consensus.cc:482] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:27:38.612241 10654 raft_consensus.cc:504] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.614704 10654 leader_election.cc:288] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:38.616590 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06a742cc4864679a56bf88d2568f2b8" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7" is_pre_election: true
I20260812 19:27:38.617141 8351 raft_consensus.cc:2454] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in term 0.
I20260812 19:27:38.617780 10676 leader_election.cc:288] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:38.618844 8443 leader_election.cc:302] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:38.619648 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06a742cc4864679a56bf88d2568f2b8" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" is_pre_election: true
I20260812 19:27:38.620354 8511 raft_consensus.cc:2454] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 93aafc5b36824666a82aa55bc73df9e7 in term 0.
I20260812 19:27:38.621183 10676 raft_consensus.cc:2781] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:38.621362 8278 leader_election.cc:302] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5, 93aafc5b36824666a82aa55bc73df9e7; no voters:
I20260812 19:27:38.621595 10676 raft_consensus.cc:482] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:38.622016 10676 raft_consensus.cc:3037] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:38.622682 10717 raft_consensus.cc:2781] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:27:38.623004 10717 raft_consensus.cc:482] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:27:38.623291 10717 raft_consensus.cc:3037] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:27:38.606253 7956 catalog_manager.cc:5495] T f093c8ebbcae4d33918a3c9f30eabb5a P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.629907 10717 raft_consensus.cc:504] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.631732 10717 leader_election.cc:288] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171)
I20260812 19:27:38.634824 10726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:38.635320 10726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:38.634728 8511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06a742cc4864679a56bf88d2568f2b8" candidate_uuid: "93aafc5b36824666a82aa55bc73df9e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5"
I20260812 19:27:38.637243 10726 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:38.639117 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:38.646281 10712 tablet_bootstrap.cc:492] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7: No bootstrap required, opened a new log
I20260812 19:27:38.646787 10712 ts_tablet_manager.cc:1397] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent bootstrapping tablet: real 0.053s user 0.008s sys 0.004s
I20260812 19:27:38.630410 7956 catalog_manager.cc:5495] T 05b8e6cecfa04aa685014277c15fb6f4 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.650821 10712 raft_consensus.cc:348] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.651533 10712 raft_consensus.cc:374] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:38.652657 10712 raft_consensus.cc:729] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 93aafc5b36824666a82aa55bc73df9e7, State: Initialized, Role: FOLLOWER
I20260812 19:27:38.653321 10712 consensus_queue.cc:260] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.655030 10712 ts_tablet_manager.cc:1428] T cdb6ba8b98474fff97ae3f45218870f0 P 93aafc5b36824666a82aa55bc73df9e7: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260812 19:27:38.655925 10712 tablet_bootstrap.cc:492] T 055ec64bd8374073b8fbe90ba0d7dbfe P 93aafc5b36824666a82aa55bc73df9e7: Bootstrap starting.
I20260812 19:27:38.649544 7956 catalog_manager.cc:5495] T 01063b51cc35482c918f74b43fa3ee8f P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.657814 7956 catalog_manager.cc:5495] T 2175811e6a7646c3ae82daaa8c626bca P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.665959 10723 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:38.659155 7956 catalog_manager.cc:5495] T 33591e906f0e433d98e07e424ea0b07f P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.669023 7956 catalog_manager.cc:5495] T 867e426fedce4c9895b7b9a13f8bb5e3 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.670166 7956 catalog_manager.cc:5495] T e9815f0f40634d83a6c6a33b2ab198df P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.671267 7956 catalog_manager.cc:5495] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.672385 7956 catalog_manager.cc:5495] T 13607c1893434a728d989eb1c8c88eea P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.673580 7956 catalog_manager.cc:5495] T f9aa94ea25c04790902a3a4d0c0099ad P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.675204 10723 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:38.678696 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6" is_pre_election: true
I20260812 19:27:38.678620 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" is_pre_election: true
I20260812 19:27:38.679322 9424 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa34b607af684984bbfb5cd60a2f058d in term 5.
I20260812 19:27:38.680756 7777 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, fa34b607af684984bbfb5cd60a2f058d; no voters:
I20260812 19:27:38.680940 7805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d" is_pre_election: true
I20260812 19:27:38.681528 7805 raft_consensus.cc:2454] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in term 5.
I20260812 19:27:38.683983 10712 tablet_bootstrap.cc:654] T 055ec64bd8374073b8fbe90ba0d7dbfe P 93aafc5b36824666a82aa55bc73df9e7: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.684598 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd, fa34b607af684984bbfb5cd60a2f058d; no voters: b99a815f68ee4d93b167a67778a3e1a6
I20260812 19:27:38.685587 10726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:27:38.685927 10726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Starting leader election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:38.686362 10726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:27:38.688405 10727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:27:38.692389 10727 raft_consensus.cc:482] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Starting leader election (detected failure of leader b99a815f68ee4d93b167a67778a3e1a6)
I20260812 19:27:38.696620 10727 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:27:38.692737 10723 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:38.666008 10676 raft_consensus.cc:504] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.702641 10676 leader_election.cc:288] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Requested vote from peers 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029), 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609)
I20260812 19:27:38.705447 10707 ts_tablet_manager.cc:1428] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.116s user 0.008s sys 0.000s
I20260812 19:27:38.706192 8511 raft_consensus.cc:2379] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 93aafc5b36824666a82aa55bc73df9e7 in current term 1: Already voted for candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in this term.
I20260812 19:27:38.706039 10727 raft_consensus.cc:504] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:38.709272 10727 leader_election.cc:288] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 election: Requested vote from peers 1e9a660a0f1e4fc6bc6335b38eece0bd (127.7.144.253:41563), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:38.710121 9424 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd"
I20260812 19:27:38.712810 10707 tablet_bootstrap.cc:492] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
I20260812 19:27:38.717859 8351 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06a742cc4864679a56bf88d2568f2b8" candidate_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "93aafc5b36824666a82aa55bc73df9e7"
I20260812 19:27:38.718595 8351 raft_consensus.cc:2379] T d06a742cc4864679a56bf88d2568f2b8 P 93aafc5b36824666a82aa55bc73df9e7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4f26a5f8e5934d8d8c026a2d957c78a5 in current term 1: Already voted for candidate 93aafc5b36824666a82aa55bc73df9e7 in this term.
I20260812 19:27:38.720677 7805 raft_consensus.cc:1226] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 6 FOLLOWER]: Rejecting Update request from peer b99a815f68ee4d93b167a67778a3e1a6 for earlier term 5. Current term is 6. Ops: []
I20260812 19:27:38.722374 10728 consensus_queue.cc:1046] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 }, Status: INVALID_TERM, Last received: 5.329, Next index: 330, Last known committed idx: 329, Time since last communication: 0.001s
I20260812 19:27:38.723729 10707 tablet_bootstrap.cc:654] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.732821 10726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:38.734313 9424 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa34b607af684984bbfb5cd60a2f058d in current term 6: Already voted for candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in this term.
W20260812 19:27:38.735596 9353 connection.cc:535] server connection from 127.7.144.193:54879 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 19:27:38.736477 9425 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 6 FOLLOWER]: Rejecting Update request from peer b99a815f68ee4d93b167a67778a3e1a6 for earlier term 5. Current term is 6. Ops: []
W20260812 19:27:38.737833 8446 connection.cc:535] client connection to 127.7.144.193:46029 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:27:38.738289 8446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:27:38.743791 8281 connection.cc:535] client connection to 127.7.144.193:46029 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:27:38.744300 8281 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 19:27:38.745090 10730 consensus_queue.cc:1046] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 }, Status: INVALID_TERM, Last received: 5.329, Next index: 330, Last known committed idx: 329, Time since last communication: 0.001s
I20260812 19:27:38.746965 10730 raft_consensus.cc:3032] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 19:27:38.747346 10730 raft_consensus.cc:729] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b99a815f68ee4d93b167a67778a3e1a6, State: Running, Role: LEADER
I20260812 19:27:38.731077 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fa34b607af684984bbfb5cd60a2f058d" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6"
I20260812 19:27:38.748092 10730 consensus_queue.cc:260] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 329, Committed index: 329, Last appended: 5.329, Last appended by leader: 329, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:38.761662 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 8253
I20260812 19:27:38.674782 7956 catalog_manager.cc:5495] T e0451c2d5d6b4851a83ee9d30aa40a6c P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.781530 10726 leader_election.cc:288] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 election: Requested vote from peers fa34b607af684984bbfb5cd60a2f058d (127.7.144.254:33521), b99a815f68ee4d93b167a67778a3e1a6 (127.7.144.252:46815)
I20260812 19:27:38.781819 7805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "fa34b607af684984bbfb5cd60a2f058d"
I20260812 19:27:38.782730 7805 raft_consensus.cc:2379] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in current term 6: Already voted for candidate fa34b607af684984bbfb5cd60a2f058d in this term.
I20260812 19:27:38.788460 7956 catalog_manager.cc:5495] T 7a530a6bcdb04b268c7a3f4becb065e2 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.790022 7956 catalog_manager.cc:5495] T 0df3401001074c62883da06902530399 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.798074 10707 tablet_bootstrap.cc:492] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5: No bootstrap required, opened a new log
I20260812 19:27:38.798494 10707 ts_tablet_manager.cc:1397] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent bootstrapping tablet: real 0.086s user 0.010s sys 0.000s
I20260812 19:27:38.799547 10730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:27:38.807505 7948 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.254:33521, user_credentials={real_user=slave}} blocked reactor thread for 75594.2us
W20260812 19:27:38.808320 7948 connection.cc:535] client connection to 127.7.144.193:46029 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:27:38.808777 7948 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 2 similar messages]
I20260812 19:27:38.808595 10707 raft_consensus.cc:348] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.809413 10707 raft_consensus.cc:374] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:38.809685 10707 raft_consensus.cc:729] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f26a5f8e5934d8d8c026a2d957c78a5, State: Initialized, Role: FOLLOWER
I20260812 19:27:38.810388 10707 consensus_queue.cc:260] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } }
I20260812 19:27:38.791555 7956 catalog_manager.cc:5495] T b51a28468ba74a8e88d0936dc3281eca P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.813133 7956 catalog_manager.cc:5495] T 311b68f298164090bc9458e3ee16f6cb P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.814883 7956 catalog_manager.cc:5495] T fac74fcb73d1489f8542496293d6141c P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.815882 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet fac74fcb73d1489f8542496293d6141c (table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d]). Expected version 1 got 0
I20260812 19:27:38.815951 7972 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa34b607af684984bbfb5cd60a2f058d in term 6.
I20260812 19:27:38.818929 7781 leader_election.cc:302] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d; no voters: 1e9a660a0f1e4fc6bc6335b38eece0bd
I20260812 19:27:38.820065 10727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:27:38.820657 10727 raft_consensus.cc:686] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [term 6 LEADER]: Becoming Leader. State: Replica: fa34b607af684984bbfb5cd60a2f058d, State: Running, Role: LEADER
I20260812 19:27:38.821553 10727 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 329, Committed index: 329, Last appended: 5.329, Last appended by leader: 329, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } }
I20260812 19:27:38.820034 7972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" candidate_term: 6 candidate_status { last_received { term: 5 index: 329 } } ignore_live_leader: false dest_uuid: "b99a815f68ee4d93b167a67778a3e1a6"
I20260812 19:27:38.823957 7972 raft_consensus.cc:2379] T 00000000000000000000000000000000 P b99a815f68ee4d93b167a67778a3e1a6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e9a660a0f1e4fc6bc6335b38eece0bd in current term 6: Already voted for candidate fa34b607af684984bbfb5cd60a2f058d in this term.
I20260812 19:27:38.828150 10723 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa34b607af684984bbfb5cd60a2f058d. Latest consensus state: current_term: 6 leader_uuid: "fa34b607af684984bbfb5cd60a2f058d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fa34b607af684984bbfb5cd60a2f058d" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 33521 } } peers { permanent_uuid: "1e9a660a0f1e4fc6bc6335b38eece0bd" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 41563 } } peers { permanent_uuid: "b99a815f68ee4d93b167a67778a3e1a6" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 46815 } } }
I20260812 19:27:38.829121 10723 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa34b607af684984bbfb5cd60a2f058d [sys.catalog]: This master's current role is: LEADER
I20260812 19:27:38.836398 8849 master_runner.cc:263] No leader master found from master 1e9a660a0f1e4fc6bc6335b38eece0bd
I20260812 19:27:38.836318 9360 leader_election.cc:302] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e9a660a0f1e4fc6bc6335b38eece0bd; no voters: b99a815f68ee4d93b167a67778a3e1a6, fa34b607af684984bbfb5cd60a2f058d
I20260812 19:27:38.836747 8849 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:27:38.837323 10726 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1e9a660a0f1e4fc6bc6335b38eece0bd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260812 19:27:38.837798 7948 catalog_manager.cc:4584] TS 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 354d9912acad4c1ba76f45ce277f1e94: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111)
W20260812 19:27:38.840864 8446 consensus_peers.cc:487] T b00a037a2567470497e1a751754df345 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.841444 8446 consensus_peers.cc:487] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.841868 8446 consensus_peers.cc:487] T 94407c13a91c4a76bd3aa1c1c8032384 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.842267 8446 consensus_peers.cc:487] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.842639 8446 consensus_peers.cc:487] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.843022 8446 consensus_peers.cc:487] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.843436 8446 consensus_peers.cc:487] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.843899 8446 consensus_peers.cc:487] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.844475 8446 consensus_peers.cc:487] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.844983 8446 consensus_peers.cc:487] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.845511 8446 consensus_peers.cc:487] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.845924 8446 leader_election.cc:334] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111)
I20260812 19:27:38.846655 10739 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260812 19:27:38.846736 8446 consensus_peers.cc:487] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.847090 8446 consensus_peers.cc:487] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.847427 8446 leader_election.cc:334] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: RPC error from VoteRequest() call to peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111)
I20260812 19:27:38.847754 8446 leader_election.cc:302] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4f26a5f8e5934d8d8c026a2d957c78a5; no voters: 6a95b50ceede4dc99913aec28ddaa380, 93aafc5b36824666a82aa55bc73df9e7
W20260812 19:27:38.860757 8446 consensus_peers.cc:487] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:38.861024 10711 raft_consensus.cc:2726] T d06a742cc4864679a56bf88d2568f2b8 P 4f26a5f8e5934d8d8c026a2d957c78a5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:27:38.867573 7956 catalog_manager.cc:5495] T 968eb13e27ea4f93a45aad17110b0ee4 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.868966 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701]). Expected version 2 got 0
I20260812 19:27:38.869621 7956 catalog_manager.cc:5495] T 89298e977bef4f519f68446bf75d0df9 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.854933 10707 ts_tablet_manager.cc:1428] T cdb6ba8b98474fff97ae3f45218870f0 P 4f26a5f8e5934d8d8c026a2d957c78a5: Time spent starting tablet: real 0.056s user 0.005s sys 0.000s
W20260812 19:27:38.889637 8446 consensus_peers.cc:487] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.890064 8446 consensus_peers.cc:487] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.890426 8446 consensus_peers.cc:487] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.890851 8446 consensus_peers.cc:487] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.891198 8446 consensus_peers.cc:487] T 6da136cadb824d18886132c8f26ccb22 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.891551 8446 consensus_peers.cc:487] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.891911 8446 consensus_peers.cc:487] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:38.871047 7956 catalog_manager.cc:5495] T 6b32b8e857c04567a2a751c379a05440 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.905380 7956 catalog_manager.cc:5495] T 841c459584534458977b6182b71c77f1 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.906702 7956 catalog_manager.cc:5495] T b4d07516dc1c4193b4cbd68185f92891 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.893558 10707 tablet_bootstrap.cc:492] T 055ec64bd8374073b8fbe90ba0d7dbfe P 4f26a5f8e5934d8d8c026a2d957c78a5: Bootstrap starting.
W20260812 19:27:38.892236 8446 consensus_peers.cc:487] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.916718 8446 consensus_peers.cc:487] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.917152 8446 consensus_peers.cc:487] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.917529 8446 consensus_peers.cc:487] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 19:27:38.917929 8446 consensus_peers.cc:487] T 69ca59e00b52437a8d7ef06ebc194af3 P 4f26a5f8e5934d8d8c026a2d957c78a5 -> Peer 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193:46029): Couldn't send request to peer 6a95b50ceede4dc99913aec28ddaa380. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.193:46029: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:27:38.927034 10707 tablet_bootstrap.cc:654] T 055ec64bd8374073b8fbe90ba0d7dbfe P 4f26a5f8e5934d8d8c026a2d957c78a5: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:38.934506 8567 heartbeater.cc:503] Master 127.7.144.252:46815 was elected leader, sending a full tablet report...
W20260812 19:27:38.948104 9353 connection.cc:535] server connection from 127.7.144.194:49957 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:27:38.948221 8443 connection.cc:535] client connection to 127.7.144.194:44609 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 19:27:38.948915 7956 catalog_manager.cc:5495] T aff8c4a6f27c499eb555d97017cb3a4c P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
W20260812 19:27:38.952343 8446 connection.cc:535] server connection from 127.7.144.194:59975 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 19:27:38.954627 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 8417
W20260812 19:27:38.954711 10735 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 19:27:38.949958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.144.194:44609 (local address 127.7.144.195:51381)
0812 19:27:38.950444 (+ 486us) negotiation.cc:107] Waiting for socket to connect
0812 19:27:38.950510 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0812 19:27:38.951041 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 19:27:38.953797 (+ 2756us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.144.194:44609: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":67,"spinlock_wait_cycles":12800}
I20260812 19:27:38.956730 7956 catalog_manager.cc:5495] T ed3743a7dde744668cbe91759a499805 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:38.964545 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]). Expected version 1 got 0
I20260812 19:27:38.967088 7956 catalog_manager.cc:5495] T 7c258a18b8da47aabafd67023d3e5812 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.970293 7956 catalog_manager.cc:5495] T b31c1afb090041d7b6ae35a846772b1d P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.975011 7956 catalog_manager.cc:5495] T 067fdfc16a7e44c2b3dac5fe262a5728 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:38.978827 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 067fdfc16a7e44c2b3dac5fe262a5728 (table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]). Expected version 1 got 0
I20260812 19:27:38.989780 7956 catalog_manager.cc:5495] T 9f0afa2f3cee483facfbb2712917b829 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:38.992575 7956 catalog_manager.cc:5495] T cc0601e681ba426991b22b6a7303ae2c P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.994094 7956 catalog_manager.cc:5495] T 95e195a643084486a74be961177bf42c P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:38.995303 7956 catalog_manager.cc:5587] TS 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194:44609) does not have the latest schema for tablet 95e195a643084486a74be961177bf42c (table default.Table_495da693476b4874bb497da7998bf531 [id=937c9f4b3b8546d6958017575c2ca587]). Expected version 1 got 0
I20260812 19:27:38.996429 7956 catalog_manager.cc:5495] T d30c274273c3496cb0a8b8650b504250 P 93aafc5b36824666a82aa55bc73df9e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.000063 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_b75ada7352e841db92ad8b1288d4482e [id=0461c5229c594c80993422651e194de0]
I20260812 19:27:39.001816 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]
I20260812 19:27:39.005290 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_de249985997d434cb02a9b69b4ac8f23 [id=0970c1dcc2674d8e970d083d156663f3]
I20260812 19:27:39.007632 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_1ba2cf16de96431e852a531d84346249 [id=0b6d2f95f16a4d4a920b8d568d9a05f0]
I20260812 19:27:39.010694 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_b5476874c6234d7ba3b6222a6e57f480 [id=16219c11f94e4916a050298fa66fe05d]
I20260812 19:27:39.012161 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_8bffdbff44404a2b8b9c8e52e0326496 [id=1955f8a6bf004a698dd6084b9c4f4825]
I20260812 19:27:39.015146 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_04cd3cfca142418d9027f11abd45ccee [id=1cb08d52dd864aefb10cb3256d3254f6]
I20260812 19:27:39.016615 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_6c57c3ce8a2f45ec8c96d3630de76779 [id=1d10c20281c949949c4068b62697a050]
I20260812 19:27:39.020320 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]
I20260812 19:27:39.023324 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_7fdbb8e821ab4dbdbb81de6d982abb4f [id=2800cba1d26d4716b33ccb14ecb83685]
I20260812 19:27:39.024763 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_b42edede4b02496c9387f0802f4379f6 [id=284a0a822ad349479d361451ecff2a07]
I20260812 19:27:39.026201 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_7eb7a40f96734c5181c10b7d4f997beb [id=28742d039bbe405da73c0a66077a888b]
I20260812 19:27:39.027616 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_f1f45ee21dc442e6a5f4808c0e64778f [id=2e5c470a5cb54d22a537dccff04b64fb]
I20260812 19:27:39.029145 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]
I20260812 19:27:39.030570 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_ea1246ee662c4855bf7e6d1d12cdeeb5 [id=31e33e46389e40ee8d8af26f39df9ff7]
I20260812 19:27:39.032027 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_46eff941aec8459a8180c13546bf30b5 [id=36fb6bc1478a42deb2e15a362db2f285]
I20260812 19:27:39.034287 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_b7c8e765cce94561ad357c2d6a61126c [id=3c820f17d99d4f09ad27e0f18e4bb569]
I20260812 19:27:39.038928 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc]
I20260812 19:27:39.040335 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_4d7c3164521944d6896c30686703b9bd [id=526fb5de11c0431dbab5d37749fb94b6]
I20260812 19:27:39.042557 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_9a72fd6596d64f3eb0d8ddb257918dad [id=54db3304e58d4c4f9c0b3786e7b9d790]
I20260812 19:27:39.044886 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_d9ab701326cf41578d26ff86740c3c06 [id=58476a06329749f58df3183114bfd735]
I20260812 19:27:39.047148 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_84a4d8dea4e74a5dbd72b6e2c747742b [id=5b37d536ff2745eb9b8fe60a07b17033]
I20260812 19:27:39.048758 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_071cfa8f627d4f2480821e78e17fce43 [id=5d1037c54e6944ef8bb57a1328c9c369]
I20260812 19:27:39.051088 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_7ab1c8c2ce1943169508c49fb732ba91 [id=5f862ea688594e9bb53e8d005ccb1c8a]
I20260812 19:27:39.052670 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_319ca0257ad14c3a8b2c51206f4ad522 [id=5fa1f4c45fb24702b4067890502222f4]
I20260812 19:27:39.054286 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_8677fb0b0ef74b8f9f9b885d63a3d8cb [id=60482d1ceb2c46ecb33a2f2b2d87e067]
I20260812 19:27:39.055754 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_f1a3995068804c0f8e952189333316f2 [id=62db093581394968bfbb7b08df201cd6]
I20260812 19:27:39.057251 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8]
I20260812 19:27:39.069195 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_e9db95034a294403b47fcd2eeaaf4696 [id=63ef136d5b03475fbb92f82d515d7c4e]
E20260812 19:27:39.013968 7956 catalog_manager.cc:5650] Error updating tablets from 93aafc5b36824666a82aa55bc73df9e7: Illegal state: replica b99a815f68ee4d93b167a67778a3e1a6 is not leader of this config: current role FOLLOWER. Tablet report was: is_incremental: false updated_tablets { tablet_id: "aff8c4a6f27c499eb555d97017cb3a4c" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26735 live_row_count: 0 } } updated_tablets { tablet_id: "89298e977bef4f519f68446bf75d0df9" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26735 live_row_count: 0 } } updated_tablets { tablet_id: "d30c274273c3496cb0a8b8650b504250" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "0df3401001074c62883da06902530399" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26769 live_row_count: 0 } } updated_tablets { tablet_id: "7c258a18b8da47aabafd67023d3e5812" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26813 live_row_count: 0 } } updated_tablets { tablet_id: "5db9e00d07964bde9f769e217236a771" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "cc0601e681ba426991b22b6a7303ae2c" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26813 live_row_count: 0 } } updated_tablets { tablet_id: "6b32b8e857c04567a2a751c379a05440" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "841c459584534458977b6182b71c77f1" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "968eb13e27ea4f93a45aad17110b0ee4" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "b51a28468ba74a8e88d0936dc3281eca" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "fac74fcb73d1489f8542496293d6141c" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "311b68f298164090bc9458e3ee16f6cb" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f9aa94ea25c04790902a3a4d0c0099ad" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e9815f0f40634d83a6c6a33b2ab198df" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "1950030ab501429a91971f80f761a172" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } } } schema_version: 1 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "13607c1893434a728d989eb1c8c88eea" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "2175811e6a7646c3ae82daaa8c626bca" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "613763d1b3074766bee2d026de516065" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "bc8ae6adf7b64a468112753c2831ac87" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "7a530a6bcdb04b268c7a3f4becb065e2" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26813 live_row_count: 0 } } updated_tablets { tablet_id: "867e426fedce4c9895b7b9a13f8bb5e3" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "e0451c2d5d6b4851a83ee9d30aa40a6c" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "f093c8ebbcae4d33918a3c9f30eabb5a" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "14e40943867249c58fee943fc8ed3fb0" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "663d0d16b9cd4bed9bb5529b514f9e30" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "c67135f8c5ae422485bca11ada90afaa" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "b31c1afb090041d7b6ae35a846772b1d" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "a91c4d5adb3d4f97939e38e9cee79532" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "6ff5b2d23d734217b0b10e50834b8883" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "9f0afa2f3cee483facfbb2712917b829" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "5f3c6d8f74d044948a893d756be9a838" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "01063b51cc35482c918f74b43fa3ee8f" state: RUNNING consensus_state { current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "b4d07516dc1c4193b4cbd68185f92891" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "05b8e6cecfa04aa685014277c15fb6f4" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "354d9912acad4c1ba76f45ce277f1e94" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "8c9d071f07e5410d9e660986ab6858ef" state: RUNNING consensus_state { current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY stats { on_disk_size: 26844 live_row_count: 0 } } updated_tablets { tablet_id: "e6ef4b3497284a799d4a4f45d7609e45" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "cfbf700d55a04b529507259406bdd5a1" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } } } schema_version: 0 tablet_data_state: TABLET_DATA_READY } updated_tablets { tablet_id: "58149ab874b44f63b01ea611814e1417" state: RUNNING consensus_state { current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.1
I20260812 19:27:39.079010 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_caee4dd38d6f441dbd7d509ab8f8bd4b [id=6892d6ec1ffa4f809504639521d5587f]
I20260812 19:27:39.080650 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_45b01d92b3ad46c381537f61225bdc9c [id=69c12bd16b424b53ab503f3fb53ae0c0]
I20260812 19:27:39.082207 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_0c4a4663fba54b6a828c70d1b50a0f36 [id=6ad4b3f784244d538e0836d507969cdc]
I20260812 19:27:39.083679 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_fa1fbd614aec4990a05779a0217a0431 [id=6ca550348c4c4fdd800bd49d4c86ac47]
I20260812 19:27:39.085482 10739 catalog_manager.cc:669] Loaded metadata for table default.Table_8d4ff5105fa143a5ae773476d55deed3 [id=70b2724108ca43ee9ff3b304e4532ba2]
W20260812 19:27:39.093209 7956 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 150) took 1239 ms (client timeout 1000 ms). Trace:
I20260812 19:27:39.093915 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 7758
W20260812 19:27:39.093538 7956 rpcz_store.cc:269] 0812 19:27:37.853592 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:27:37.853860 (+ 268us) service_pool.cc:227] Handling call
0812 19:27:39.013712 (+1159852us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:39.013736 (+ 24us) write_op.cc:454] Released schema lock
0812 19:27:39.093128 (+ 79392us) inbound_call.cc:173] Queueing failure response
Related trace 'op':
0812 19:27:39.013452 (+ 0us) op_driver.cc:372] HandleFailure(Illegal state: replica b99a815f68ee4d93b167a67778a3e1a6 is not leader of this config: current role FOLLOWER)
0812 19:27:39.013512 (+ 60us) write_op.cc:489] Releasing partition, row and schema locks
0812 19:27:39.013533 (+ 21us) write_op.cc:454] Released schema lock
0812 19:27:39.013566 (+ 33us) write_op.cc:335] FINISH: Op aborted
Metrics: {"reported_tablets":97,"child_traces":[["op",{}]]}
W20260812 19:27:39.096377 7946 connection.cc:441] server connection from 127.7.144.194:55939 torn down before Call kudu.master.MasterService.TSHeartbeat from 127.7.144.194:55939 (request call id 150) could send its response
I20260812 19:27:39.115535 7957 catalog_manager.cc:5495] T 5717f521074d49c6baec431f0d739c91 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.116662 7957 catalog_manager.cc:5495] T d4d4e8d3d6ef40058b29f7cc574a5565 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.117714 7957 catalog_manager.cc:5495] T fbff8d38116d4af9ba9497f65e876827 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.118645 7957 catalog_manager.cc:5495] T b07f7215876740519164e7d7e08302bd P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 2 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.119302 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet b07f7215876740519164e7d7e08302bd (table default.Table_d63b1c802a2849bd8c2b6ec1b9c67c68 [id=309ef846b27d432cbc664c17ab7e3970]). Expected version 1 got 0
I20260812 19:27:39.119758 7957 catalog_manager.cc:5495] T f41e6528b71e4d35a6aee94bb7dd7a57 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.120757 7957 catalog_manager.cc:5495] T 9b5e92063f494c79be75371f2626b1e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.121776 7957 catalog_manager.cc:5495] T 9be4dabb7fa042bd8fa6b45fa63e8674 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.122519 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 9be4dabb7fa042bd8fa6b45fa63e8674 (table default.Table_66db0774e1a04c57831ea5f32f5db73e [id=aa94f3441db84ccd8c38b637bb675cb4]). Expected version 1 got 0
I20260812 19:27:39.123332 7957 catalog_manager.cc:5495] T 0df3401001074c62883da06902530399 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.124512 7957 catalog_manager.cc:5495] T e0a53a91dc9e41d58ee4f6a083ca204c P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.125485 7957 catalog_manager.cc:5495] T 92d412842c9c4dd0bb47e774d1df8e4b P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.126438 7957 catalog_manager.cc:5495] T c6075b2e46524829962d2b84353013b2 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:39.127094 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet c6075b2e46524829962d2b84353013b2 (table default.Table_f012e6c4368d4fcea457cb5be9a8750a [id=525ff469b92d436fba5e9319b7ddb9fc]). Expected version 2 got 0
I20260812 19:27:39.127611 7957 catalog_manager.cc:5495] T 0fd84e685b2b4e819f4b61e442828b13 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.128397 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 0fd84e685b2b4e819f4b61e442828b13 (table default.Table_50b2712b6ba44c49ad3692f26f9ee0f7 [id=2541695fa76f4d9ca6b65bd64225de44]). Expected version 1 got 0
I20260812 19:27:39.128906 7957 catalog_manager.cc:5495] T 622deb66eead473189ab85a53cb8c81f P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.129827 7957 catalog_manager.cc:5495] T 7b689d49a1244c7fb12ba84853f2da9d P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 2 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.130554 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 7b689d49a1244c7fb12ba84853f2da9d (table default.Table_f9028eb48cef4d429e1b9a950161cf59 [id=d5c42d7392754ff895f4bc07163d2afe]). Expected version 2 got 0
I20260812 19:27:39.131011 7957 catalog_manager.cc:5495] T f6f3a2193f2744249de635be4f949889 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.131889 7957 catalog_manager.cc:5495] T 7764a1ae009142b29d5fb574dca45e21 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.132640 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 7764a1ae009142b29d5fb574dca45e21 (table default.Table_767024638c874185886b998ebb58a292 [id=631e82b9e6c445fc92aa599ee0aa44e8]). Expected version 2 got 0
I20260812 19:27:39.133181 7957 catalog_manager.cc:5495] T 787047cca4ce4c6884ce5bd07a93f077 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.134003 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 787047cca4ce4c6884ce5bd07a93f077 (table default.Table_0c4a4663fba54b6a828c70d1b50a0f36 [id=6ad4b3f784244d538e0836d507969cdc]). Expected version 1 got 0
I20260812 19:27:39.134467 7957 catalog_manager.cc:5495] T c607886a76344185aa9af5da797b9ae8 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.135375 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet c607886a76344185aa9af5da797b9ae8 (table default.Table_fefff8bc40ae422b9363d2750dd22382 [id=98ce767a90c14e65873ae81aad05ada6]). Expected version 2 got 0
I20260812 19:27:39.136503 7957 catalog_manager.cc:5495] T c881ad61438d4a978e3c479aefcfa4cb P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.137679 7957 catalog_manager.cc:5495] T e67867b6cb864b47ba7b115e12cddb17 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.138752 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet e67867b6cb864b47ba7b115e12cddb17 (table default.Table_45af8c6f1cfb45d6bb659c47a4e00169 [id=7d0fca66d4be45bab2673ba518b22f2e]). Expected version 1 got 0
I20260812 19:27:39.139669 7957 catalog_manager.cc:5495] T 140266bae6254efe9b87d0f8e3bfaa4e P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.141166 7957 catalog_manager.cc:5495] T a2b4ef63a53540e6be590243b1d27330 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.142426 7957 catalog_manager.cc:5495] T 9bdb7cce923c4ed98e400c121b6237ba P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
W20260812 19:27:39.143196 7946 catalog_manager.cc:4639] Async tablet task AlterTable RPC for tablet 787047cca4ce4c6884ce5bd07a93f077 (table default.Table_0c4a4663fba54b6a828c70d1b50a0f36 [id=6ad4b3f784244d538e0836d507969cdc], current schema version=1) failed: Not found: failed to reset TS proxy: No leader found: Tablet 787047cca4ce4c6884ce5bd07a93f077 consensus state has no leader
I20260812 19:27:39.143366 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 9bdb7cce923c4ed98e400c121b6237ba (table default.Table_c1665280164645aeaa0ada50bf7e6629 [id=ea7ebd72106345978b7ccd28e8599c2b]). Expected version 1 got 0
I20260812 19:27:39.143908 7957 catalog_manager.cc:5495] T 7a530a6bcdb04b268c7a3f4becb065e2 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.144834 7957 catalog_manager.cc:5495] T bc8ae6adf7b64a468112753c2831ac87 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.145594 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet bc8ae6adf7b64a468112753c2831ac87 (table default.Table_85621ff136c84b2b95ebfc4fdbfa646b [id=0479fcb4d0ff44bd98ce28beddd898be]). Expected version 1 got 0
I20260812 19:27:39.146062 7957 catalog_manager.cc:5495] T 867e426fedce4c9895b7b9a13f8bb5e3 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.146929 7957 catalog_manager.cc:5495] T e0451c2d5d6b4851a83ee9d30aa40a6c P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.147857 7957 catalog_manager.cc:5495] T cc0601e681ba426991b22b6a7303ae2c P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.148988 7957 catalog_manager.cc:5495] T 5db9e00d07964bde9f769e217236a771 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.150518 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 8849
I20260812 19:27:39.150806 7957 catalog_manager.cc:5495] T 9293d85d08c34dbeb3f324322f2d656c P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.153214 7957 catalog_manager.cc:5495] T 5f3c6d8f74d044948a893d756be9a838 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.154335 7957 catalog_manager.cc:5495] T 6ff5b2d23d734217b0b10e50834b8883 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.155934 7957 catalog_manager.cc:5495] T 663d0d16b9cd4bed9bb5529b514f9e30 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.157614 7957 catalog_manager.cc:5495] T b31c1afb090041d7b6ae35a846772b1d P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.158990 7957 catalog_manager.cc:5495] T a91c4d5adb3d4f97939e38e9cee79532 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:39.160408 7957 catalog_manager.cc:5495] T c67135f8c5ae422485bca11ada90afaa P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.161790 7957 catalog_manager.cc:5495] T b4d07516dc1c4193b4cbd68185f92891 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:39.163131 7957 catalog_manager.cc:5495] T 05b8e6cecfa04aa685014277c15fb6f4 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.164579 7957 catalog_manager.cc:5495] T 01063b51cc35482c918f74b43fa3ee8f P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.166378 7957 catalog_manager.cc:5495] T f093c8ebbcae4d33918a3c9f30eabb5a P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.168128 7957 catalog_manager.cc:5495] T aff8c4a6f27c499eb555d97017cb3a4c P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.169577 7957 catalog_manager.cc:5495] T 841c459584534458977b6182b71c77f1 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.171236 7957 catalog_manager.cc:5495] T 6b32b8e857c04567a2a751c379a05440 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:39.172683 7957 catalog_manager.cc:5495] T 2175811e6a7646c3ae82daaa8c626bca P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.174273 7957 catalog_manager.cc:5495] T 33591e906f0e433d98e07e424ea0b07f P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.175900 7957 catalog_manager.cc:5495] T 13607c1893434a728d989eb1c8c88eea P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.177522 7957 catalog_manager.cc:5495] T e9815f0f40634d83a6c6a33b2ab198df P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.179507 7957 catalog_manager.cc:5495] T fac74fcb73d1489f8542496293d6141c P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.180863 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet fac74fcb73d1489f8542496293d6141c (table default.Table_5d48b4b4f8cb4a1e84677661d3407119 [id=b0061a6abcd549b78cca5456d2dfd87d]). Expected version 1 got 0
I20260812 19:27:39.181665 7957 catalog_manager.cc:5495] T 311b68f298164090bc9458e3ee16f6cb P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.183256 7957 catalog_manager.cc:5495] T 968eb13e27ea4f93a45aad17110b0ee4 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.184428 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 968eb13e27ea4f93a45aad17110b0ee4 (table default.Table_6c98a9b63da5451ba194086ad4db81f6 [id=97f951f5bce143dbac6324c558577701]). Expected version 2 got 0
I20260812 19:27:39.185104 7957 catalog_manager.cc:5495] T b51a28468ba74a8e88d0936dc3281eca P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.186509 7957 catalog_manager.cc:5495] T f9aa94ea25c04790902a3a4d0c0099ad P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.188133 7957 catalog_manager.cc:5495] T 067fdfc16a7e44c2b3dac5fe262a5728 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } }
I20260812 19:27:39.189317 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 067fdfc16a7e44c2b3dac5fe262a5728 (table default.Table_63c9865ea2de4a1fa2ffee030ee0e003 [id=e7004daceb8248e38a52995d0dff69ce]). Expected version 1 got 0
I20260812 19:27:39.189975 7957 catalog_manager.cc:5495] T 9f0afa2f3cee483facfbb2712917b829 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.191612 7957 catalog_manager.cc:5495] T 95e195a643084486a74be961177bf42c P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.192796 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet 95e195a643084486a74be961177bf42c (table default.Table_495da693476b4874bb497da7998bf531 [id=937c9f4b3b8546d6958017575c2ca587]). Expected version 1 got 0
I20260812 19:27:39.193485 7957 catalog_manager.cc:5495] T 89298e977bef4f519f68446bf75d0df9 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.194865 7957 catalog_manager.cc:5495] T d8f522d072cc4ae0a4cc98f1bb88fbc6 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.196538 7957 catalog_manager.cc:5495] T ed3743a7dde744668cbe91759a499805 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6a95b50ceede4dc99913aec28ddaa380 (127.7.144.193). New cstate: current_term: 1 leader_uuid: "6a95b50ceede4dc99913aec28ddaa380" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } }
I20260812 19:27:39.197686 7957 catalog_manager.cc:5587] TS 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195:33171) does not have the latest schema for tablet ed3743a7dde744668cbe91759a499805 (table default.Table_24a63660a17a4b1e92b364bfe17e8b4c [id=929e4d1c71874efb91489e20baa5a4ef]). Expected version 1 got 0
I20260812 19:27:39.198360 7957 catalog_manager.cc:5495] T 7c258a18b8da47aabafd67023d3e5812 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 93aafc5b36824666a82aa55bc73df9e7 (127.7.144.194). New cstate: current_term: 1 leader_uuid: "93aafc5b36824666a82aa55bc73df9e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } } }
I20260812 19:27:39.199813 7957 catalog_manager.cc:5495] T d30c274273c3496cb0a8b8650b504250 P 4f26a5f8e5934d8d8c026a2d957c78a5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4f26a5f8e5934d8d8c026a2d957c78a5 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f26a5f8e5934d8d8c026a2d957c78a5" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 33171 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "93aafc5b36824666a82aa55bc73df9e7" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 44609 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6a95b50ceede4dc99913aec28ddaa380" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 46029 } health_report { overall_health: HEALTHY } } }
I20260812 19:27:39.222319 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 7915
2026-08-12T19:27:39Z chronyd exiting
I20260812 19:27:39.302376 7747 master-stress-test.cc:586] Tables created: 138
I20260812 19:27:39.302578 7747 master-stress-test.cc:587] Tables altered: 62
I20260812 19:27:39.302716 7747 master-stress-test.cc:588] Tables deleted: 52
I20260812 19:27:39.302834 7747 master-stress-test.cc:589] Tablets replaced: 18
I20260812 19:27:39.302956 7747 master-stress-test.cc:590] Masters restarted: 1
[ OK ] CatalogManagerConfigurations/MasterStressTest.Test/0 (67789 ms)
[ RUN ] CatalogManagerConfigurations/MasterStressTest.Test/3
I20260812 19:27:39.417367 7747 test_util.cc:268] Using random seed: -1801797889
2026-08-12T19:27:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-12T19:27:39Z Disabled control of system clock
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskmh1KKU/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskmh1KKU/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Metastore connection URL: jdbc:derby:/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/metadb;create=true
Metastore Connection Driver : org.apache.derby.jdbc.EmbeddedDriver
Metastore connection User: APP
Starting metastore schema initialization to 3.1.0
Initialization script hive-schema-3.1.0.derby.sql
Initialization script completed
schemaTool completed
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/security.properties
2026-08-12 19:27:46: Starting Hive Metastore Server
Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/derby.log -Djava.security.properties=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/security.properties
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskmh1KKU/thirdparty/src/hive-3.1.2/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/tmp/dist-test-taskmh1KKU/thirdparty/src/hadoop-3.2.0/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
Starting hive metastore on port 0
I20260812 19:27:54.311843 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.254:36253
--webserver_interface=127.7.144.254
--webserver_port=0
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--hive_metastore_uris=thrift://127.0.0.1:36931
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
W20260812 19:27:54.630409 11004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:27:54.631078 11004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:27:54.631593 11004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:27:54.663120 11004 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260812 19:27:54.663411 11004 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260812 19:27:54.663709 11004 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:27:54.663978 11004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:27:54.664233 11004 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:27:54.664577 11004 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:27:54.702455 11004 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/wal
--hive_metastore_uris=thrift://127.0.0.1:36931
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.254:36253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.7.144.254
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:27:54.703801 11004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:27:54.705587 11004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:27:54.725688 11012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:54.725764 11011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:54.725802 11014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:54.727038 11004 server_base.cc:1034] running on GCE node
I20260812 19:27:55.924880 11004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:27:55.927650 11004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:27:55.929011 11004 hybrid_clock.cc:648] HybridClock initialized: now 1786562875928987 us; error 44 us; skew 500 ppm
I20260812 19:27:55.929877 11004 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:55.943967 11004 webserver.cc:460] Webserver started at http://127.7.144.254:41217/ using document root <none> and password file <none>
I20260812 19:27:55.945026 11004 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:55.945278 11004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:55.945808 11004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:27:55.951048 11004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data/instance:
uuid: "2b825f98e3684b83869afc840fa6e68a"
format_stamp: "Formatted at 2026-08-12 19:27:55 on dist-test-slave-0b58"
I20260812 19:27:55.952245 11004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/wal/instance:
uuid: "2b825f98e3684b83869afc840fa6e68a"
format_stamp: "Formatted at 2026-08-12 19:27:55 on dist-test-slave-0b58"
I20260812 19:27:55.960420 11004 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260812 19:27:55.966347 11024 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:27:55.967476 11004 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.006s sys 0.000s
I20260812 19:27:55.967832 11004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/wal
uuid: "2b825f98e3684b83869afc840fa6e68a"
format_stamp: "Formatted at 2026-08-12 19:27:55 on dist-test-slave-0b58"
I20260812 19:27:55.968184 11004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:56.005157 11004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:27:56.006830 11004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:27:56.007359 11004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:56.083793 11004 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.254:36253
I20260812 19:27:56.083915 11083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.254:36253 every 8 connection(s)
I20260812 19:27:56.086681 11004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/data/info.pb
I20260812 19:27:56.092028 11084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:56.096304 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 11004
I20260812 19:27:56.096750 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-0/wal/instance
I20260812 19:27:56.099392 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.253:33833
--webserver_interface=127.7.144.253
--webserver_port=0
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--hive_metastore_uris=thrift://127.0.0.1:36931
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 19:27:56.104139 11084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:27:56.132670 11084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } has no permanent_uuid. Determining permanent_uuid...
W20260812 19:27:56.135398 11027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:27:56.139726 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:27:56.189285 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } attempt: 1
W20260812 19:27:56.193250 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:27:56.261739 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } attempt: 2
W20260812 19:27:56.265681 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:27:56.357188 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } attempt: 3
W20260812 19:27:56.361047 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:27:56.425053 11086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:27:56.425611 11086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:27:56.426029 11086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:27:56.457295 11086 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260812 19:27:56.457541 11086 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260812 19:27:56.457746 11086 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:27:56.457940 11086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:27:56.458134 11086 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:27:56.458326 11086 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:27:56.494171 11086 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/wal
--hive_metastore_uris=thrift://127.0.0.1:36931
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.253:33833
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.7.144.253
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:27:56.495360 11086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:27:56.497135 11086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 19:27:56.504539 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } attempt: 4
W20260812 19:27:56.509888 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:27:56.515957 11096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:56.809396 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } attempt: 5
W20260812 19:27:56.814213 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:27:57.361595 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } attempt: 6
W20260812 19:27:57.369792 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:27:56.516240 11098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:56.516675 11095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:27:56.518535 11086 server_base.cc:1034] running on GCE node
I20260812 19:27:57.718045 11086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:27:57.721307 11086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:27:57.722762 11086 hybrid_clock.cc:648] HybridClock initialized: now 1786562877722717 us; error 62 us; skew 500 ppm
I20260812 19:27:57.723650 11086 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:57.730829 11086 webserver.cc:460] Webserver started at http://127.7.144.253:38625/ using document root <none> and password file <none>
I20260812 19:27:57.731928 11086 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:57.732246 11086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:57.732867 11086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:27:57.737934 11086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data/instance:
uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4"
format_stamp: "Formatted at 2026-08-12 19:27:57 on dist-test-slave-0b58"
I20260812 19:27:57.739010 11086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/wal/instance:
uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4"
format_stamp: "Formatted at 2026-08-12 19:27:57 on dist-test-slave-0b58"
I20260812 19:27:57.746479 11086 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.003s
I20260812 19:27:57.752543 11107 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:27:57.753787 11086 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260812 19:27:57.754166 11086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/wal
uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4"
format_stamp: "Formatted at 2026-08-12 19:27:57 on dist-test-slave-0b58"
I20260812 19:27:57.754557 11086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:57.798633 11086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:27:57.800323 11086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:27:57.800817 11086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:57.874743 11086 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.253:33833
I20260812 19:27:57.874981 11164 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.253:33833 every 8 connection(s)
I20260812 19:27:57.877754 11086 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/data/info.pb
I20260812 19:27:57.880779 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 11086
I20260812 19:27:57.881347 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-1/wal/instance
I20260812 19:27:57.884316 11165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:57.885195 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:41467
--webserver_interface=127.7.144.252
--webserver_port=0
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--hive_metastore_uris=thrift://127.0.0.1:36931
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 19:27:57.900668 11165 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:27:57.930249 11165 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:27:57.946111 11165 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } has no permanent_uuid. Determining permanent_uuid...
W20260812 19:27:57.948621 11109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
W20260812 19:27:57.952898 11165 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.002488 11165 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 1
W20260812 19:27:58.006551 11165 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.075045 11165 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 2
W20260812 19:27:58.079052 11165 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.170563 11165 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 3
W20260812 19:27:58.174536 11165 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
W20260812 19:27:58.222127 11166 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:27:58.223063 11166 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:27:58.223977 11166 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:27:58.259730 11166 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260812 19:27:58.259984 11166 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260812 19:27:58.260186 11166 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:27:58.260465 11166 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:27:58.260669 11166 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:27:58.260855 11166 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:27:58.298032 11166 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36931
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:41467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.144.252
--webserver_port=0
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:27:58.299316 11166 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:27:58.301039 11166 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260812 19:27:58.318018 11165 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 4
W20260812 19:27:58.320597 11179 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:58.323110 11165 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.430209 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } attempt: 7
I20260812 19:27:58.444509 11084 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } has no permanent_uuid. Determining permanent_uuid...
W20260812 19:27:58.449985 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.508635 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 1
W20260812 19:27:58.514146 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.595639 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 2
W20260812 19:27:58.600795 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.622532 11165 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 5
W20260812 19:27:58.627518 11165 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.686321 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 3
W20260812 19:27:58.691365 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:58.831802 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 4
W20260812 19:27:58.836457 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:59.120106 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 5
W20260812 19:27:59.124919 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:59.174952 11165 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 6
W20260812 19:27:59.182145 11165 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
W20260812 19:27:58.322028 11182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:58.320668 11176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:27:59.519055 11180 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260812 19:27:59.519192 11166 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260812 19:27:59.523608 11166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:27:59.526908 11166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:27:59.528388 11166 hybrid_clock.cc:648] HybridClock initialized: now 1786562879528333 us; error 75 us; skew 500 ppm
I20260812 19:27:59.529282 11166 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:27:59.535930 11166 webserver.cc:460] Webserver started at http://127.7.144.252:46487/ using document root <none> and password file <none>
I20260812 19:27:59.536981 11166 fs_manager.cc:359] Metadata directory not provided
I20260812 19:27:59.537222 11166 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:27:59.537741 11166 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:27:59.542896 11166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/instance:
uuid: "f056fc7d059f449da00729dc497e4da3"
format_stamp: "Formatted at 2026-08-12 19:27:59 on dist-test-slave-0b58"
I20260812 19:27:59.544044 11166 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal/instance:
uuid: "f056fc7d059f449da00729dc497e4da3"
format_stamp: "Formatted at 2026-08-12 19:27:59 on dist-test-slave-0b58"
I20260812 19:27:59.551486 11166 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260812 19:27:59.557247 11193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:27:59.558482 11166 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 19:27:59.558836 11166 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
uuid: "f056fc7d059f449da00729dc497e4da3"
format_stamp: "Formatted at 2026-08-12 19:27:59 on dist-test-slave-0b58"
I20260812 19:27:59.559192 11166 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:27:59.611209 11166 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:27:59.612867 11166 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:27:59.613359 11166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:27:59.677500 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 6
W20260812 19:27:59.684935 11084 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.7.144.252:41467: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:27:59.689536 11166 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.252:41467
I20260812 19:27:59.689638 11256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.252:41467 every 8 connection(s)
I20260812 19:27:59.692333 11166 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
I20260812 19:27:59.695017 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 11166
I20260812 19:27:59.695463 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal/instance
I20260812 19:27:59.697434 11257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:27:59.716692 11257 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:27:59.741930 11257 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:27:59.753391 11257 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } has no permanent_uuid. Determining permanent_uuid...
I20260812 19:27:59.771723 11257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Bootstrap starting.
I20260812 19:27:59.778797 11257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Neither blocks nor log segments found. Creating new log.
I20260812 19:27:59.780681 11257 log.cc:824] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Log is configured to *not* fsync() on all Append() calls
I20260812 19:27:59.786592 11257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: No bootstrap required, opened a new log
I20260812 19:27:59.811632 11257 raft_consensus.cc:348] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:27:59.812477 11257 raft_consensus.cc:374] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:27:59.812764 11257 raft_consensus.cc:729] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Initialized, Role: FOLLOWER
I20260812 19:27:59.813555 11257 consensus_queue.cc:260] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:27:59.816155 11264 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:27:59.816823 11264 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:27:59.817818 11257 sys_catalog.cc:564] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: configured and running, proceeding with master startup.
W20260812 19:27:59.855841 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.856345 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.868784 11199 tablet.cc:2369] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 19:27:59.871656 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.881114 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:27:59.847640 11166 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: OK, instance_id { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" instance_seqno: 1786562876062694 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260812 19:27:59.887224 11166 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:27:59.895833 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.896144 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.910460 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.910774 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.925055 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.925381 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.939707 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.940032 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.956532 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.956847 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.971694 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.972069 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.985452 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.985735 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:27:59.998994 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:27:59.999245 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.012322 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.012586 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.025709 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.026086 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.039105 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.039498 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.053833 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.054152 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.068588 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.069099 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.084031 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.084379 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.098627 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.098956 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.113144 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.113464 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.127693 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.128019 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.142347 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.142731 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.156823 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.157135 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.171332 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.171648 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.185864 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.186216 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.199098 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.199389 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.212383 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.212664 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.228056 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.228469 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.241745 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.241988 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.242805 11165 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 7
I20260812 19:28:00.245369 11264 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:00.245882 11264 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:00.248407 11264 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:00.256304 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.256608 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.267234 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Bootstrap starting.
W20260812 19:28:00.270664 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.270948 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.274358 11165 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:00.276719 11165 log.cc:824] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Log is configured to *not* fsync() on all Append() calls
I20260812 19:28:00.282245 11165 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: No bootstrap required, opened a new log
W20260812 19:28:00.284742 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.285013 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.301059 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.301349 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.313273 11165 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:00.314117 11165 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:00.314468 11165 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0ebc7fa78c6461fb1baa698aaf99ee4, State: Initialized, Role: FOLLOWER
W20260812 19:28:00.315064 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.315349 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.315407 11165 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:00.318279 11284 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:00.319253 11284 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:00.320312 11165 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:28:00.320518 11137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:00.321412 11137 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 0.
I20260812 19:28:00.322809 11196 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3; no voters:
I20260812 19:28:00.323997 11264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:00.324347 11264 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:00.324769 11264 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:00.331406 11264 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:00.341760 11137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4"
I20260812 19:28:00.342316 11137 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:28:00.344978 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.345244 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.350538 11137 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 1.
I20260812 19:28:00.351292 11264 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 1 election: Requested vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
I20260812 19:28:00.351888 11196 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3; no voters:
I20260812 19:28:00.352911 11264 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:00.364939 11264 raft_consensus.cc:686] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 1 LEADER]: Becoming Leader. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Running, Role: LEADER
I20260812 19:28:00.369127 11264 consensus_queue.cc:237] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
W20260812 19:28:00.407516 11302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.407953 11302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.423123 11302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.423527 11302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.394369 11086 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: OK, instance_id { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" instance_seqno: 1786562876062694 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
W20260812 19:28:00.428875 11279 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260812 19:28:00.429041 11086 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:28:00.429174 11279 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.432816 11297 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f056fc7d059f449da00729dc497e4da3. Latest consensus state: current_term: 1 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:00.433619 11297 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:00.436407 11305 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
W20260812 19:28:00.442297 11302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.442607 11302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.443425 11305 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260812 19:28:00.457118 11302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.457576 11302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.464123 11137 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Refusing update from remote peer f056fc7d059f449da00729dc497e4da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:28:00.465962 11297 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:28:00.480993 11302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.482038 11302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.517584 11284 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f056fc7d059f449da00729dc497e4da3. Latest consensus state: current_term: 1 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:00.518855 11284 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: FOLLOWER
W20260812 19:28:00.522660 11302 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260812 19:28:00.523008 11302 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.526623 11306 mvcc.cc:205] Tried to move back new op lower bound from 7317761558359805952 to 7317761558080966656. Current Snapshot: MvccSnapshot[applied={T|T < 7317761558359805952}]
I20260812 19:28:00.534873 11307 mvcc.cc:205] Tried to move back new op lower bound from 7317761558359805952 to 7317761558080966656. Current Snapshot: MvccSnapshot[applied={T|T < 7317761558359805952}]
I20260812 19:28:00.541752 11297 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:00.542546 11297 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:00.543728 11305 catalog_manager.cc:1347] Generated new cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:00.544008 11305 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:28:00.550088 11284 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:00.554195 11284 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:00.585522 11302 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:00.586877 11302 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: loading cluster ID for follower catalog manager: success
W20260812 19:28:00.605400 11302 catalog_manager.cc:1576] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260812 19:28:00.607317 11302 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.623950 11302 catalog_manager.cc:1576] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260812 19:28:00.624585 11302 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.651948 11305 catalog_manager.cc:1370] Generated new certificate authority record
W20260812 19:28:00.663561 11302 catalog_manager.cc:1576] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260812 19:28:00.665371 11302 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.666653 11305 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:28:00.699960 11302 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: acquiring CA information for follower catalog manager: success
I20260812 19:28:00.718318 11084 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } attempt: 7
W20260812 19:28:00.718894 11302 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.734998 11302 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
W20260812 19:28:00.763039 11302 catalog_manager.cc:873] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry
I20260812 19:28:00.773219 11305 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Generated new TSK 0
I20260812 19:28:00.774848 11305 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:28:00.778119 11084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Bootstrap starting.
I20260812 19:28:00.787153 11305 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260812 19:28:00.791947 11084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:00.792001 11305 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260812 19:28:00.793020 11302 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 19:28:00.806947 11084 log.cc:824] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Log is configured to *not* fsync() on all Append() calls
I20260812 19:28:00.820819 11084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: No bootstrap required, opened a new log
I20260812 19:28:00.821434 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.144.193:0
--local_ip_for_outbound_sockets=127.7.144.193
--webserver_interface=127.7.144.193
--webserver_port=0
--tserver_master_addrs=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
W20260812 19:28:00.879572 11194 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.144.254:36253 timed out after 0.629s (SENT)
I20260812 19:28:00.895241 11084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:00.897732 11084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:00.898659 11084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b825f98e3684b83869afc840fa6e68a, State: Initialized, Role: FOLLOWER
I20260812 19:28:00.901733 11084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:00.923571 11084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:28:00.923751 11052 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:00.924727 11052 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 0.
I20260812 19:28:00.926333 11055 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:00.928114 11055 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 0.
W20260812 19:28:00.928655 11055 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51666 (request call id 2) took 679 ms (client timeout 629 ms). Trace:
W20260812 19:28:00.929049 11055 rpcz_store.cc:269] 0812 19:28:00.248849 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:28:00.249003 (+ 154us) service_pool.cc:227] Handling call
0812 19:28:00.928571 (+679568us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:28:00.931051 11054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a"
W20260812 19:28:00.932646 11054 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51666 (request call id 3) took 592 ms (client timeout 683 ms). Trace:
W20260812 19:28:00.932984 11054 rpcz_store.cc:269] 0812 19:28:00.340047 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:28:00.340200 (+ 153us) service_pool.cc:227] Handling call
0812 19:28:00.932586 (+592386us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260812 19:28:00.934274 11053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:00.942770 11053 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Refusing update from remote peer f056fc7d059f449da00729dc497e4da3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 19:28:00.944641 11297 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:28:00.944433 11315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:00.945315 11315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
W20260812 19:28:01.019832 11032 tablet.cc:2369] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:28:01.109315 11315 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f056fc7d059f449da00729dc497e4da3. Latest consensus state: current_term: 1 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:01.110514 11315 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:01.111972 11325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:01.112974 11325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:01.216770 11340 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:01.217046 11340 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: loading cluster ID for follower catalog manager: success
I20260812 19:28:01.245631 11340 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: acquiring CA information for follower catalog manager: success
I20260812 19:28:01.251844 11340 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 19:28:01.294142 11342 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:01.294934 11342 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:01.304908 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:01.306313 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:01.309478 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0ebc7fa78c6461fb1baa698aaf99ee4; no voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:01.312640 11342 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:01.313745 11342 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:01.450455 11325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:01.450980 11325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:01.455948 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:01.457145 11137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:01.458273 11325 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:01.460160 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:01.461555 11325 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:01.488945 11297 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:01.489771 11297 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: LEADER
W20260812 19:28:01.549121 11313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:28:01.549918 11313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:28:01.550998 11313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:28:01.618484 11313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:28:01.620302 11313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.144.193
I20260812 19:28:01.711472 11313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.144.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.7.144.193
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.144.193
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:28:01.713415 11313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:28:01.715714 11313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:28:01.812827 11355 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:02.736395 11361 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:02.742137 11361 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:02.748828 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:02.767745 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:02.771579 11109 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0ebc7fa78c6461fb1baa698aaf99ee4; no voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:02.778328 11361 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:02.781617 11361 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:03.357940 11364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:03.358546 11364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:03.361774 11137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:03.363721 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:03.366164 11027 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:03.371335 11364 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:03.373134 11364 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:28:01.821133 11357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:28:01.814075 11353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:01.813210 11313 server_base.cc:1034] running on GCE node
I20260812 19:28:03.443723 11313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:28:03.446926 11313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:28:03.448387 11313 hybrid_clock.cc:648] HybridClock initialized: now 1786562883448312 us; error 82 us; skew 500 ppm
I20260812 19:28:03.449515 11313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:28:03.461259 11313 webserver.cc:460] Webserver started at http://127.7.144.193:43107/ using document root <none> and password file <none>
I20260812 19:28:03.462335 11313 fs_manager.cc:359] Metadata directory not provided
I20260812 19:28:03.462591 11313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:28:03.463099 11313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:28:03.468878 11313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data/instance:
uuid: "7ae3a240f89541df8f79c381ff857110"
format_stamp: "Formatted at 2026-08-12 19:28:03 on dist-test-slave-0b58"
I20260812 19:28:03.470293 11313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/instance:
uuid: "7ae3a240f89541df8f79c381ff857110"
format_stamp: "Formatted at 2026-08-12 19:28:03 on dist-test-slave-0b58"
I20260812 19:28:03.480238 11313 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.006s sys 0.005s
I20260812 19:28:03.487210 11371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:03.488864 11313 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260812 19:28:03.489399 11313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal
uuid: "7ae3a240f89541df8f79c381ff857110"
format_stamp: "Formatted at 2026-08-12 19:28:03 on dist-test-slave-0b58"
I20260812 19:28:03.489801 11313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:28:03.555945 11313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:28:03.557978 11313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:28:03.558550 11313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:28:03.562098 11313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:28:03.568149 11313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:28:03.568454 11313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260812 19:28:03.568746 11313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:28:03.568938 11313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:03.717285 11446 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:03.717995 11446 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:03.722993 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:03.726157 11446 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:03.727504 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:03.729079 11109 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0ebc7fa78c6461fb1baa698aaf99ee4; no voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:03.730150 11446 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:03.800436 11313 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.193:41739
I20260812 19:28:03.800608 11495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.193:41739 every 8 connection(s)
I20260812 19:28:03.803081 11313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/data/info.pb
I20260812 19:28:03.804577 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 11313
I20260812 19:28:03.805346 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/instance
I20260812 19:28:03.830612 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.144.194:0
--local_ip_for_outbound_sockets=127.7.144.194
--webserver_interface=127.7.144.194
--webserver_port=0
--tserver_master_addrs=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 19:28:03.878647 11496 heartbeater.cc:347] Connected to a master server at 127.7.144.253:33833
I20260812 19:28:03.879400 11496 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:03.889261 11496 heartbeater.cc:511] Master 127.7.144.253:33833 requested a full tablet report, sending...
I20260812 19:28:03.893730 11127 ts_manager.cc:194] Registered new tserver with Master: 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739)
I20260812 19:28:03.896097 11500 heartbeater.cc:347] Connected to a master server at 127.7.144.254:36253
I20260812 19:28:03.896447 11500 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:03.897321 11500 heartbeater.cc:511] Master 127.7.144.254:36253 requested a full tablet report, sending...
I20260812 19:28:03.900458 11044 ts_manager.cc:194] Registered new tserver with Master: 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739)
I20260812 19:28:03.913550 11497 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:03.913941 11497 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:03.914819 11497 heartbeater.cc:511] Master 127.7.144.252:41467 requested a full tablet report, sending...
I20260812 19:28:03.917599 11212 ts_manager.cc:194] Registered new tserver with Master: 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739)
I20260812 19:28:03.920672 11212 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.144.193:39617
W20260812 19:28:04.284624 11506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:28:04.285168 11506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:28:04.285785 11506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:28:04.319082 11506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:28:04.320197 11506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.144.194
I20260812 19:28:04.359481 11506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.144.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.7.144.194
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.144.194
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:28:04.360827 11506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:28:04.362435 11506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:28:04.393569 11515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:04.395653 11516 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:04.396111 11516 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:04.399088 11137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:04.402997 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:04.404217 11516 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:04.405509 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:04.408887 11516 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:04.425930 11497 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
I20260812 19:28:04.676800 11524 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:04.677537 11524 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:04.680739 11524 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:04.682739 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:04.683084 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:04.685644 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0ebc7fa78c6461fb1baa698aaf99ee4; no voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:04.687207 11524 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:04.936523 11525 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:04.937527 11525 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:04.942525 11137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:04.947664 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:04.951841 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:04.958251 11525 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:04.959830 11525 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:05.530115 11528 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:05.531071 11528 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:05.537595 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:05.540792 11528 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:05.542636 11137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:05.545997 11027 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:05.547087 11528 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 19:28:04.398720 11517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:28:05.763530 11519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:28:05.765779 11518 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1366 milliseconds
I20260812 19:28:05.765925 11506 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260812 19:28:05.767197 11506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:28:05.770153 11506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:28:05.771596 11506 hybrid_clock.cc:648] HybridClock initialized: now 1786562885771561 us; error 53 us; skew 500 ppm
I20260812 19:28:05.772514 11506 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:28:05.780126 11506 webserver.cc:460] Webserver started at http://127.7.144.194:43605/ using document root <none> and password file <none>
I20260812 19:28:05.781185 11506 fs_manager.cc:359] Metadata directory not provided
I20260812 19:28:05.781383 11506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:28:05.781805 11506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:28:05.787321 11506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data/instance:
uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
format_stamp: "Formatted at 2026-08-12 19:28:05 on dist-test-slave-0b58"
I20260812 19:28:05.788637 11506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/instance:
uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
format_stamp: "Formatted at 2026-08-12 19:28:05 on dist-test-slave-0b58"
I20260812 19:28:05.796814 11506 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260812 19:28:05.803378 11534 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:05.804873 11506 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.003s
I20260812 19:28:05.805289 11506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal
uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
format_stamp: "Formatted at 2026-08-12 19:28:05 on dist-test-slave-0b58"
I20260812 19:28:05.805796 11506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:28:05.848482 11506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:28:05.850008 11506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:28:05.850456 11506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:28:05.853305 11506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:28:05.857914 11506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:28:05.858111 11506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:05.858433 11506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:28:05.858597 11506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:06.028192 11506 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.194:41189
I20260812 19:28:06.028329 11666 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.194:41189 every 8 connection(s)
I20260812 19:28:06.030902 11506 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/data/info.pb
I20260812 19:28:06.039124 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 11506
I20260812 19:28:06.039808 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/instance
I20260812 19:28:06.064459 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.7.144.195:0
--local_ip_for_outbound_sockets=127.7.144.195
--webserver_interface=127.7.144.195
--webserver_port=0
--tserver_master_addrs=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--heartbeat_rpc_timeout_ms=1000
--heartbeat_max_failures_before_backoff=1
--heartbeat_interval_ms=500 with env {}
I20260812 19:28:06.081598 11680 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:06.082314 11680 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.088814 11678 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:06.089598 11678 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.093271 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:06.093884 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in term 1.
I20260812 19:28:06.096158 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4; no voters:
I20260812 19:28:06.097901 11668 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:06.098435 11668 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:06.099713 11668 heartbeater.cc:511] Master 127.7.144.252:41467 requested a full tablet report, sending...
I20260812 19:28:06.103405 11212 ts_manager.cc:194] Registered new tserver with Master: 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:06.105429 11212 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.144.194:54807
I20260812 19:28:06.107067 11684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 19:28:06.107511 11684 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:06.108098 11684 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:28:06.112330 11680 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:06.114022 11670 heartbeater.cc:347] Connected to a master server at 127.7.144.254:36253
I20260812 19:28:06.114482 11670 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:06.114784 11136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:06.115108 11678 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:06.115264 11670 heartbeater.cc:511] Master 127.7.144.254:36253 requested a full tablet report, sending...
I20260812 19:28:06.116044 11667 heartbeater.cc:347] Connected to a master server at 127.7.144.253:33833
I20260812 19:28:06.116469 11667 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:06.117195 11667 heartbeater.cc:511] Master 127.7.144.253:33833 requested a full tablet report, sending...
I20260812 19:28:06.117070 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:06.121081 11044 ts_manager.cc:194] Registered new tserver with Master: 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:06.121388 11684 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.122133 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:06.123013 11136 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2b825f98e3684b83869afc840fa6e68a in current term 2: Already voted for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in this term.
I20260812 19:28:06.127022 11027 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:06.127985 11127 ts_manager.cc:194] Registered new tserver with Master: 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:06.128510 11678 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:28:06.129307 11137 raft_consensus.cc:1226] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 FOLLOWER]: Rejecting Update request from peer f056fc7d059f449da00729dc497e4da3 for earlier term 1. Current term is 2. Ops: []
I20260812 19:28:06.132449 11686 consensus_queue.cc:1046] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:28:06.135535 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a"
I20260812 19:28:06.136504 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3"
I20260812 19:28:06.138481 11684 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 election: Requested vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:06.140121 11687 raft_consensus.cc:3032] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 19:28:06.140522 11687 raft_consensus.cc:729] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Running, Role: LEADER
I20260812 19:28:06.141330 11687 consensus_queue.cc:260] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.141889 11678 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 19:28:06.142640 11687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 1 FOLLOWER]: Advancing to term 2
I20260812 19:28:06.149331 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in term 2.
I20260812 19:28:06.154907 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4; no voters: f056fc7d059f449da00729dc497e4da3
I20260812 19:28:06.155333 11279 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 19:28:06.155840 11684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 19:28:06.156317 11684 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 LEADER]: Becoming Leader. State: Replica: c0ebc7fa78c6461fb1baa698aaf99ee4, State: Running, Role: LEADER
I20260812 19:28:06.157148 11684 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.161803 11680 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ebc7fa78c6461fb1baa698aaf99ee4. Latest consensus state: current_term: 2 leader_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:06.162534 11680 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:06.167520 11690 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:28:06.175465 11690 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:28:06.179600 11690 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:06.179870 11690 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:28:06.184585 11690 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:28:06.188485 11690 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Loaded TSK: 0
I20260812 19:28:06.190584 11690 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:28:06.193531 11690 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260812 19:28:06.196312 11690 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
W20260812 19:28:06.473647 11682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:28:06.474221 11682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:28:06.474931 11682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:28:06.509379 11682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:28:06.510385 11682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.144.195
I20260812 19:28:06.549628 11682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--raft_heartbeat_interval_ms=1000
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.7.144.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.7.144.195
--webserver_port=0
--heartbeat_interval_ms=500
--heartbeat_max_failures_before_backoff=1
--heartbeat_rpc_timeout_ms=1000
--tserver_master_addrs=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.7.144.195
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:28:06.551080 11682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:28:06.552898 11682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:28:06.573323 11700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:06.611871 11668 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
I20260812 19:28:06.638432 11687 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:06.639138 11687 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.642855 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:06.642030 11687 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
I20260812 19:28:06.643332 11136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:06.643764 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 2.
I20260812 19:28:06.645172 11194 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3; no voters:
I20260812 19:28:06.646266 11687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 19:28:06.646548 11687 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:06.646834 11687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:28:06.652040 11687 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.654908 11687 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 3 election: Requested vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
I20260812 19:28:06.654919 11053 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 2 FOLLOWER]: Refusing update from remote peer c0ebc7fa78c6461fb1baa698aaf99ee4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260812 19:28:06.655431 11054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a"
I20260812 19:28:06.656514 11054 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:28:06.656508 11136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4"
I20260812 19:28:06.656766 11680 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:28:06.667049 11054 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 3.
I20260812 19:28:06.668269 11053 raft_consensus.cc:1226] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 3 FOLLOWER]: Rejecting Update request from peer c0ebc7fa78c6461fb1baa698aaf99ee4 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260812 19:28:06.669049 11194 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:06.669806 11687 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 19:28:06.670989 11687 raft_consensus.cc:686] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 3 LEADER]: Becoming Leader. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Running, Role: LEADER
I20260812 19:28:06.671828 11687 consensus_queue.cc:237] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.672124 11680 consensus_queue.cc:1046] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:28:06.674389 11680 raft_consensus.cc:3032] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 19:28:06.674947 11680 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c0ebc7fa78c6461fb1baa698aaf99ee4, State: Running, Role: LEADER
I20260812 19:28:06.675877 11705 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f056fc7d059f449da00729dc497e4da3. Latest consensus state: current_term: 3 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:06.676714 11705 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:06.676452 11680 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:06.678629 11680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 2 FOLLOWER]: Advancing to term 3
I20260812 19:28:06.679450 11709 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:28:06.684947 11709 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:28:06.687981 11709 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:06.688474 11709 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:28:06.693724 11709 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:28:06.698246 11709 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Loaded TSK: 0
I20260812 19:28:06.699676 11709 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:28:06.703505 11709 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260812 19:28:06.707249 11709 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260812 19:28:06.919709 11496 heartbeater.cc:503] Master 127.7.144.253:33833 was elected leader, sending a full tablet report...
I20260812 19:28:07.137142 11667 heartbeater.cc:503] Master 127.7.144.253:33833 was elected leader, sending a full tablet report...
I20260812 19:28:07.183794 11680 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:07.184379 11680 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.186326 11680 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:07.187489 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:07.187657 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:07.188242 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in term 3.
I20260812 19:28:07.189510 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4; no voters: f056fc7d059f449da00729dc497e4da3
I20260812 19:28:07.190371 11680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 19:28:07.190863 11680 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:07.191298 11680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:28:07.201875 11680 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.204731 11680 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 4 election: Requested vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:07.205430 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a"
I20260812 19:28:07.205979 11053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:28:07.205911 11225 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3"
I20260812 19:28:07.211789 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in term 4.
I20260812 19:28:07.212760 11136 raft_consensus.cc:1226] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 4 FOLLOWER]: Rejecting Update request from peer f056fc7d059f449da00729dc497e4da3 for earlier term 3. Current term is 4. Ops: []
I20260812 19:28:07.213830 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4; no voters: f056fc7d059f449da00729dc497e4da3
I20260812 19:28:07.214951 11680 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 19:28:07.214582 11710 consensus_queue.cc:1046] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:28:07.216105 11680 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 4 LEADER]: Becoming Leader. State: Replica: c0ebc7fa78c6461fb1baa698aaf99ee4, State: Running, Role: LEADER
I20260812 19:28:07.216948 11710 consensus_queue.cc:1225] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Peer c0ebc7fa78c6461fb1baa698aaf99ee4 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:28:07.216934 11680 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.217553 11712 raft_consensus.cc:3032] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 19:28:07.218099 11712 raft_consensus.cc:729] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Running, Role: LEADER
I20260812 19:28:07.219036 11712 consensus_queue.cc:260] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.221498 11712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 3 FOLLOWER]: Advancing to term 4
I20260812 19:28:07.221711 11711 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ebc7fa78c6461fb1baa698aaf99ee4. Latest consensus state: current_term: 4 leader_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:07.222607 11711 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:07.229332 11715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:28:07.235994 11715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:28:07.238610 11715 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:07.238842 11715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:28:07.242123 11715 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:28:07.244866 11715 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Loaded TSK: 0
I20260812 19:28:07.245988 11715 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:28:07.248950 11715 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260812 19:28:07.252281 11715 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260812 19:28:07.454957 11497 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
I20260812 19:28:07.621191 11668 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
I20260812 19:28:07.632894 11712 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:07.633404 11712 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.635303 11712 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
I20260812 19:28:07.636128 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:07.636672 11136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
I20260812 19:28:07.636771 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 4.
I20260812 19:28:07.637712 11194 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3; no voters:
I20260812 19:28:07.638489 11712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 19:28:07.638859 11712 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:07.639113 11712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:28:07.644529 11712 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.646304 11712 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 5 election: Requested vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
I20260812 19:28:07.647346 11136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4"
I20260812 19:28:07.647825 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a"
I20260812 19:28:07.648422 11053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:28:07.652951 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f056fc7d059f449da00729dc497e4da3 in term 5.
I20260812 19:28:07.653985 11194 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:07.654799 11712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 19:28:07.655265 11712 raft_consensus.cc:686] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 LEADER]: Becoming Leader. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Running, Role: LEADER
I20260812 19:28:07.655860 11712 consensus_queue.cc:237] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.658600 11710 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f056fc7d059f449da00729dc497e4da3. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:07.659160 11710 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:07.660490 11716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:28:07.666796 11716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:28:07.667275 11225 raft_consensus.cc:1226] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 LEADER]: Rejecting Update request from peer c0ebc7fa78c6461fb1baa698aaf99ee4 for earlier term 4. Current term is 5. Ops: []
I20260812 19:28:07.668994 11711 consensus_queue.cc:1046] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:28:07.669667 11711 consensus_queue.cc:1225] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Peer f056fc7d059f449da00729dc497e4da3 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:28:07.670113 11680 raft_consensus.cc:3032] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 19:28:07.670368 11716 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:07.670445 11680 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c0ebc7fa78c6461fb1baa698aaf99ee4, State: Running, Role: LEADER
I20260812 19:28:07.670653 11716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:28:07.671260 11680 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:07.672526 11680 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 4 FOLLOWER]: Advancing to term 5
I20260812 19:28:07.674382 11716 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:28:07.677547 11716 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Loaded TSK: 0
I20260812 19:28:07.678587 11716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:28:07.681919 11716 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260812 19:28:07.684443 11716 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
W20260812 19:28:06.574378 11698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:06.575467 11682 server_base.cc:1034] running on GCE node
W20260812 19:28:06.574616 11702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:07.847594 11682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:28:07.850085 11682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:28:07.851495 11682 hybrid_clock.cc:648] HybridClock initialized: now 1786562887851473 us; error 58 us; skew 500 ppm
I20260812 19:28:07.852553 11682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:28:07.859489 11682 webserver.cc:460] Webserver started at http://127.7.144.195:45481/ using document root <none> and password file <none>
I20260812 19:28:07.860483 11682 fs_manager.cc:359] Metadata directory not provided
I20260812 19:28:07.860682 11682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:28:07.861130 11682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 19:28:07.866622 11682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data/instance:
uuid: "1cc50828dde64ba6a456762a258fc744"
format_stamp: "Formatted at 2026-08-12 19:28:07 on dist-test-slave-0b58"
I20260812 19:28:07.867791 11682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/instance:
uuid: "1cc50828dde64ba6a456762a258fc744"
format_stamp: "Formatted at 2026-08-12 19:28:07 on dist-test-slave-0b58"
I20260812 19:28:07.875872 11682 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.001s sys 0.005s
I20260812 19:28:07.883149 11721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:07.884539 11682 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.006s sys 0.001s
I20260812 19:28:07.884900 11682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal
uuid: "1cc50828dde64ba6a456762a258fc744"
format_stamp: "Formatted at 2026-08-12 19:28:07 on dist-test-slave-0b58"
I20260812 19:28:07.885269 11682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:28:07.923521 11682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:28:07.925341 11682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:28:07.925843 11682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:28:07.926595 11496 heartbeater.cc:503] Master 127.7.144.253:33833 was elected leader, sending a full tablet report...
I20260812 19:28:07.929629 11682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260812 19:28:07.934381 11682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 19:28:07.934629 11682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:07.934988 11682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260812 19:28:07.935164 11682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:08.065897 11053 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 5 FOLLOWER]: Refusing update from remote peer f056fc7d059f449da00729dc497e4da3: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 19:28:08.067345 11710 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 19:28:08.074605 11825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f056fc7d059f449da00729dc497e4da3. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.075704 11825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:08.080685 11712 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.081616 11712 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:08.082412 11136 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: Refusing update from remote peer f056fc7d059f449da00729dc497e4da3: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260812 19:28:08.082890 11136 pending_rounds.cc:76] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Aborting all ops after (but not including) 5
I20260812 19:28:08.083173 11136 pending_rounds.cc:97] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260812 19:28:08.083494 11136 raft_consensus.cc:2866] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:28:08.093353 11712 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260812 19:28:08.094225 11712 consensus_queue.cc:1225] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [LEADER]: Peer c0ebc7fa78c6461fb1baa698aaf99ee4 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260812 19:28:08.097574 11136 pending_rounds.cc:76] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Aborting all ops after (but not including) 4
I20260812 19:28:08.097952 11136 pending_rounds.cc:97] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260812 19:28:08.098289 11136 raft_consensus.cc:2866] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 19:28:08.108038 11825 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.108840 11825 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:08.108027 11837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.111359 11680 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f056fc7d059f449da00729dc497e4da3. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.112123 11680 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:08.111920 11711 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.112267 11837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:08.112624 11711 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:08.113257 11842 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "f056fc7d059f449da00729dc497e4da3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.113931 11842 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:08.131340 11682 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.195:43133
I20260812 19:28:08.131508 11851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.195:43133 every 8 connection(s)
I20260812 19:28:08.134200 11682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/data/info.pb
I20260812 19:28:08.136117 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 11682
I20260812 19:28:08.137019 7747 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/instance
I20260812 19:28:08.145313 11667 heartbeater.cc:503] Master 127.7.144.253:33833 was elected leader, sending a full tablet report...
I20260812 19:28:08.231310 11852 heartbeater.cc:347] Connected to a master server at 127.7.144.253:33833
I20260812 19:28:08.231882 11852 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:08.233152 11852 heartbeater.cc:511] Master 127.7.144.253:33833 requested a full tablet report, sending...
I20260812 19:28:08.236629 11127 ts_manager.cc:194] Registered new tserver with Master: 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:08.242945 11858 heartbeater.cc:347] Connected to a master server at 127.7.144.254:36253
I20260812 19:28:08.243338 11858 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:08.244311 11858 heartbeater.cc:511] Master 127.7.144.254:36253 requested a full tablet report, sending...
I20260812 19:28:08.247511 11044 ts_manager.cc:194] Registered new tserver with Master: 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:08.257583 11853 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:08.257933 11853 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:08.258646 11853 heartbeater.cc:511] Master 127.7.144.252:41467 requested a full tablet report, sending...
I20260812 19:28:08.261188 11211 ts_manager.cc:194] Registered new tserver with Master: 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:08.264075 11211 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.7.144.195:54011
I20260812 19:28:08.280628 7747 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260812 19:28:08.331223 11211 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36082:
name: "default.Table_790d8e4400e84a078b13df4b7b4c6ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:08.331645 11212 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36082:
name: "default.Table_279342716cbf40c182ee3606ef8f6012"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:08.334908 11210 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36082:
name: "default.Table_c61586dbd5154f9a80c6e66da55197d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:08.340760 11209 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36082:
name: "default.Table_d39ddbbb97d342f980386549e6e3fa6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:28:08.343463 11211 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_790d8e4400e84a078b13df4b7b4c6ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:28:08.349262 11210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c61586dbd5154f9a80c6e66da55197d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:28:08.351462 11212 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_279342716cbf40c182ee3606ef8f6012 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:28:08.380975 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 11166
I20260812 19:28:08.464246 11497 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
W20260812 19:28:08.470131 11497 heartbeater.cc:644] Failed to heartbeat to 127.7.144.252:41467 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
W20260812 19:28:08.428377 11868 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.144.252:41467)
W20260812 19:28:08.509618 11868 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.CreateTable -> {remote=127.7.144.252:41467, user_credentials={real_user=slave}} blocked reactor thread for 84652.1us
I20260812 19:28:08.580642 11837 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:08.581132 11837 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:08.583361 11837 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:08.585577 11136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" is_pre_election: true
W20260812 19:28:08.595378 11026 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111) [suppressed 13 similar messages]
I20260812 19:28:08.601728 11711 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
I20260812 19:28:08.602228 11711 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:08.604169 11711 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:08.605039 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:08.605666 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in term 5.
I20260812 19:28:08.612020 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4; no voters:
I20260812 19:28:08.612937 11711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 19:28:08.613278 11711 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f056fc7d059f449da00729dc497e4da3)
W20260812 19:28:08.613354 11109 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111) [suppressed 6 similar messages]
I20260812 19:28:08.613657 11711 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 5 FOLLOWER]: Advancing to term 6
W20260812 19:28:08.614002 11026 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467): Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:08.614521 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:08.615358 11837 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:28:08.620784 11711 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:08.625592 11711 leader_election.cc:288] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 6 election: Requested vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:08.627774 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a"
I20260812 19:28:08.628427 11053 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:28:08.628651 11668 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
W20260812 19:28:08.632978 11668 heartbeater.cc:644] Failed to heartbeat to 127.7.144.252:41467 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:08.637251 11053 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in term 6.
W20260812 19:28:08.638136 11109 leader_election.cc:334] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467): Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:08.638540 11108 leader_election.cc:302] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4; no voters:
I20260812 19:28:08.639458 11711 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 19:28:08.640471 11711 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [term 6 LEADER]: Becoming Leader. State: Replica: c0ebc7fa78c6461fb1baa698aaf99ee4, State: Running, Role: LEADER
I20260812 19:28:08.641269 11711 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:08.645288 11901 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ebc7fa78c6461fb1baa698aaf99ee4. Latest consensus state: current_term: 6 leader_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
W20260812 19:28:08.650578 11109 leader_election.cc:334] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467): Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:08.645972 11901 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:08.659164 11902 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:28:08.666275 11902 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:28:08.674468 11902 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:08.674755 11902 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:28:08.679750 11902 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:28:08.683614 11902 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Loaded TSK: 0
I20260812 19:28:08.685061 11902 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:28:08.690629 11902 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260812 19:28:08.694437 11902 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260812 19:28:08.710455 11127 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_c61586dbd5154f9a80c6e66da55197d9"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:08.712626 11126 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_d39ddbbb97d342f980386549e6e3fa6c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:08.710599 11124 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_790d8e4400e84a078b13df4b7b4c6ed5"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:08.714782 11125 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_279342716cbf40c182ee3606ef8f6012"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260812 19:28:08.730149 11125 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_279342716cbf40c182ee3606ef8f6012 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:28:08.730851 11126 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_d39ddbbb97d342f980386549e6e3fa6c in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:28:08.731997 11127 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_c61586dbd5154f9a80c6e66da55197d9 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260812 19:28:08.730172 11124 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table default.table_790d8e4400e84a078b13df4b7b4c6ed5 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 19:28:08.768316 11853 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
W20260812 19:28:08.778151 11853 heartbeater.cc:644] Failed to heartbeat to 127.7.144.252:41467 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:08.916000 11126 catalog_manager.cc:2148] created HMS catalog entry for table [id=b0eeb9d318d642f38479d6946246ecdb]
W20260812 19:28:08.941200 11109 consensus_peers.cc:487] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 -> Peer f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467): Couldn't send request to peer f056fc7d059f449da00729dc497e4da3. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:28:08.943813 11053 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Refusing update from remote peer c0ebc7fa78c6461fb1baa698aaf99ee4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260812 19:28:08.946059 11901 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 19:28:08.953157 11837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0ebc7fa78c6461fb1baa698aaf99ee4. Latest consensus state: current_term: 6 leader_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.953902 11837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:08.965534 11901 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.966131 11901 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4 [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:08.975545 11126 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53200:
table { table_name: "default.Table_d39ddbbb97d342f980386549e6e3fa6c" } new_table_name: "default.Table_14f1ef71159241808156342751f747e6" modify_external_catalogs: true
I20260812 19:28:08.976861 11837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:08.977584 11837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:09.031594 11127 catalog_manager.cc:2148] created HMS catalog entry for table [id=17bbb9453e9f4b22ba0d33f5174eec71]
I20260812 19:28:09.067830 11127 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53200:
table { table_name: "default.Table_c61586dbd5154f9a80c6e66da55197d9" } new_table_name: "default.Table_7a3fe4a2893a48cea8ca3e70e6bc3298" modify_external_catalogs: true
I20260812 19:28:09.073688 11775 tablet_service.cc:1467] Processing CreateTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.076543 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aecdd597baa47cfa84313b07cb9e450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.088199 11424 tablet_service.cc:1467] Processing CreateTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.089414 11423 tablet_service.cc:1467] Processing CreateTablet for tablet 23a0a8245a8d4ae68fddedb3c3ec357e (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.092180 11423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a0a8245a8d4ae68fddedb3c3ec357e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.095288 11774 tablet_service.cc:1467] Processing CreateTablet for tablet 23a0a8245a8d4ae68fddedb3c3ec357e (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.096053 11424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aecdd597baa47cfa84313b07cb9e450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.096700 11774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a0a8245a8d4ae68fddedb3c3ec357e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.098929 11590 tablet_service.cc:1467] Processing CreateTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.100889 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8aecdd597baa47cfa84313b07cb9e450. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.099064 11589 tablet_service.cc:1467] Processing CreateTablet for tablet 23a0a8245a8d4ae68fddedb3c3ec357e (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.103766 11589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23a0a8245a8d4ae68fddedb3c3ec357e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.140094 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:41467
--webserver_interface=127.7.144.252
--webserver_port=46487
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--hive_metastore_uris=thrift://127.0.0.1:36931
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 19:28:09.173666 11920 tablet_bootstrap.cc:492] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:09.183614 11920 tablet_bootstrap.cc:654] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.192917 11920 log.cc:824] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Log is configured to *not* fsync() on all Append() calls
I20260812 19:28:09.200582 11922 tablet_bootstrap.cc:492] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:09.207960 11920 tablet_bootstrap.cc:492] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:09.208528 11920 ts_tablet_manager.cc:1397] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.035s user 0.015s sys 0.000s
I20260812 19:28:09.209497 11917 tablet_bootstrap.cc:492] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:09.212929 11122 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_05da0fc81466451091ddbe2cb3550364"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:09.221520 11121 master_service.cc:946] ReplaceTablet: received request to replace tablet 8aecdd597baa47cfa84313b07cb9e450 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:09.223451 11922 tablet_bootstrap.cc:654] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.230815 11922 log.cc:824] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Log is configured to *not* fsync() on all Append() calls
I20260812 19:28:09.242375 11120 master_service.cc:946] ReplaceTablet: received request to replace tablet 8aecdd597baa47cfa84313b07cb9e450 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:09.245935 11917 tablet_bootstrap.cc:654] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.248637 11917 log.cc:824] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Log is configured to *not* fsync() on all Append() calls
I20260812 19:28:09.250381 11852 heartbeater.cc:503] Master 127.7.144.253:33833 was elected leader, sending a full tablet report...
I20260812 19:28:09.253991 11121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Sending DeleteTablet for 3 replicas of tablet 8aecdd597baa47cfa84313b07cb9e450
I20260812 19:28:09.259793 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:09.265949 11118 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_305f7ed346be4cfc8f4291849bf77448"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:09.270423 11125 catalog_manager.cc:2148] created HMS catalog entry for table [id=b1e50453323d4d02aeded5f539bcec7b]
I20260812 19:28:09.273375 11121 catalog_manager.cc:6565] ReplaceTablet: tablet 8aecdd597baa47cfa84313b07cb9e450 deleted and replaced by tablet 240122ac351f49d3bf225725b270a1d2
I20260812 19:28:09.273406 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:09.284749 11423 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:09.296527 11922 tablet_bootstrap.cc:492] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
W20260812 19:28:09.295984 11110 catalog_manager.cc:4821] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): delete failed for tablet 8aecdd597baa47cfa84313b07cb9e450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aecdd597baa47cfa84313b07cb9e450 already in progress: creating tablet
I20260812 19:28:09.297084 11922 ts_tablet_manager.cc:1397] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.097s user 0.010s sys 0.008s
I20260812 19:28:09.305788 11125 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53200:
table { table_name: "default.Table_279342716cbf40c182ee3606ef8f6012" } modify_external_catalogs: true
I20260812 19:28:09.306658 11125 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53200:
table { table_name: "default.Table_279342716cbf40c182ee3606ef8f6012" } modify_external_catalogs: true
I20260812 19:28:09.324599 11775 tablet_service.cc:1467] Processing CreateTablet for tablet 240122ac351f49d3bf225725b270a1d2 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.325829 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 240122ac351f49d3bf225725b270a1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.326068 11589 tablet_service.cc:1467] Processing CreateTablet for tablet 240122ac351f49d3bf225725b270a1d2 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.327252 11589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 240122ac351f49d3bf225725b270a1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.330948 11424 tablet_service.cc:1467] Processing CreateTablet for tablet 240122ac351f49d3bf225725b270a1d2 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.332027 11424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 240122ac351f49d3bf225725b270a1d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.368454 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 68d708b92b844bcaa3051f337e6ac94a (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.369777 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d708b92b844bcaa3051f337e6ac94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.373742 11590 tablet_service.cc:1467] Processing CreateTablet for tablet 68d708b92b844bcaa3051f337e6ac94a (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.365810 11920 raft_consensus.cc:348] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } }
I20260812 19:28:09.375131 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d708b92b844bcaa3051f337e6ac94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.375319 11920 raft_consensus.cc:374] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.383848 11775 tablet_service.cc:1467] Processing CreateTablet for tablet 68d708b92b844bcaa3051f337e6ac94a (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:09.385628 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 68d708b92b844bcaa3051f337e6ac94a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:09.375638 11920 raft_consensus.cc:729] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.389441 11920 consensus_queue.cc:260] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } }
W20260812 19:28:09.391690 11111 catalog_manager.cc:4821] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): delete failed for tablet 8aecdd597baa47cfa84313b07cb9e450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aecdd597baa47cfa84313b07cb9e450 already in progress: creating tablet
I20260812 19:28:09.390085 11917 tablet_bootstrap.cc:492] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:09.392524 11917 ts_tablet_manager.cc:1397] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.184s user 0.024s sys 0.006s
W20260812 19:28:09.400624 11109 catalog_manager.cc:4821] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): delete failed for tablet 8aecdd597baa47cfa84313b07cb9e450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aecdd597baa47cfa84313b07cb9e450 already in progress: creating tablet
I20260812 19:28:09.406623 11920 ts_tablet_manager.cc:1428] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.198s user 0.033s sys 0.005s
I20260812 19:28:09.409292 11920 tablet_bootstrap.cc:492] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:09.413409 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:09.414499 11926 tablet_replica.cc:330] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:09.415270 11926 raft_consensus.cc:2229] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:09.415305 11920 tablet_bootstrap.cc:654] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.419981 11926 raft_consensus.cc:2258] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:09.421888 11922 raft_consensus.cc:348] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.422884 11926 ts_tablet_manager.cc:1905] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:09.423123 11922 raft_consensus.cc:374] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.423517 11922 raft_consensus.cc:729] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.424917 11922 consensus_queue.cc:260] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.429952 11920 tablet_bootstrap.cc:492] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:09.430415 11920 ts_tablet_manager.cc:1397] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.005s
I20260812 19:28:09.433779 11920 raft_consensus.cc:348] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.434719 11920 raft_consensus.cc:374] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.435096 11920 raft_consensus.cc:729] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.436162 11920 consensus_queue.cc:260] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.442266 11920 ts_tablet_manager.cc:1428] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.012s user 0.004s sys 0.005s
I20260812 19:28:09.443666 11920 tablet_bootstrap.cc:492] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:09.448721 11496 heartbeater.cc:503] Master 127.7.144.253:33833 was elected leader, sending a full tablet report...
I20260812 19:28:09.450620 11920 tablet_bootstrap.cc:654] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.461087 11117 master_service.cc:946] ReplaceTablet: received request to replace tablet 8aecdd597baa47cfa84313b07cb9e450 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:09.463968 11667 heartbeater.cc:503] Master 127.7.144.253:33833 was elected leader, sending a full tablet report...
I20260812 19:28:09.466764 11423 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:54630
W20260812 19:28:09.468881 11111 catalog_manager.cc:4821] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): delete failed for tablet 8aecdd597baa47cfa84313b07cb9e450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aecdd597baa47cfa84313b07cb9e450 already in progress: creating tablet
I20260812 19:28:09.469997 11922 ts_tablet_manager.cc:1428] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.173s user 0.038s sys 0.013s
I20260812 19:28:09.466538 11926 ts_tablet_manager.cc:1918] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:09.477456 11926 log.cc:1196] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/8aecdd597baa47cfa84313b07cb9e450
I20260812 19:28:09.478461 11926 ts_tablet_manager.cc:1939] T 8aecdd597baa47cfa84313b07cb9e450 P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:09.480589 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:49978
W20260812 19:28:09.482167 11110 catalog_manager.cc:4821] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): delete failed for tablet 8aecdd597baa47cfa84313b07cb9e450 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 8aecdd597baa47cfa84313b07cb9e450 already in progress: creating tablet
I20260812 19:28:09.484583 11922 tablet_bootstrap.cc:492] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
W20260812 19:28:09.487253 11863 tablet.cc:2369] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:28:09.490543 11109 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet 8aecdd597baa47cfa84313b07cb9e450 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:09.495335 11120 master_service.cc:946] ReplaceTablet: received request to replace tablet 8aecdd597baa47cfa84313b07cb9e450 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:09.502966 11120 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_78fcf6ed4cc84fd08834fb2962652e3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:09.499375 11922 tablet_bootstrap.cc:654] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.534345 11920 tablet_bootstrap.cc:492] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:09.535077 11920 ts_tablet_manager.cc:1397] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.092s user 0.017s sys 0.029s
I20260812 19:28:09.538228 11920 raft_consensus.cc:348] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.539712 11920 raft_consensus.cc:374] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.540184 11920 raft_consensus.cc:729] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.540970 11920 consensus_queue.cc:260] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.542932 11920 ts_tablet_manager.cc:1428] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20260812 19:28:09.543744 11920 tablet_bootstrap.cc:492] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:09.560087 11920 tablet_bootstrap.cc:654] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.563089 11922 tablet_bootstrap.cc:492] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:09.563544 11922 ts_tablet_manager.cc:1397] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.079s user 0.014s sys 0.018s
I20260812 19:28:09.566246 11922 raft_consensus.cc:348] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } }
I20260812 19:28:09.566972 11922 raft_consensus.cc:374] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.567253 11922 raft_consensus.cc:729] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.573560 11920 tablet_bootstrap.cc:492] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:09.573995 11920 ts_tablet_manager.cc:1397] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.030s user 0.008s sys 0.008s
I20260812 19:28:09.567889 11922 consensus_queue.cc:260] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } }
I20260812 19:28:09.578207 11922 ts_tablet_manager.cc:1428] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.014s user 0.005s sys 0.002s
I20260812 19:28:09.574493 11917 raft_consensus.cc:348] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.579312 11917 raft_consensus.cc:374] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.579627 11917 raft_consensus.cc:729] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.580632 11917 consensus_queue.cc:260] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.583499 11922 tablet_bootstrap.cc:492] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:09.589764 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:09.590359 11922 tablet_bootstrap.cc:654] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.590659 11925 tablet_replica.cc:330] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
W20260812 19:28:09.590847 11676 tablet.cc:2369] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:28:09.593453 11920 raft_consensus.cc:348] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.594193 11920 raft_consensus.cc:374] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.594460 11920 raft_consensus.cc:729] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.595573 11925 raft_consensus.cc:2229] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:09.596141 11925 raft_consensus.cc:2258] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:09.597246 11920 consensus_queue.cc:260] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.599392 11920 ts_tablet_manager.cc:1428] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.025s user 0.003s sys 0.003s
I20260812 19:28:09.603417 11925 ts_tablet_manager.cc:1905] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260812 19:28:09.625530 11109 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.144.252:41467, user_credentials={real_user=slave}} blocked reactor thread for 74382.7us
I20260812 19:28:09.642758 11917 ts_tablet_manager.cc:1428] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.240s user 0.034s sys 0.019s
I20260812 19:28:09.644804 11922 tablet_bootstrap.cc:492] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:09.645298 11922 ts_tablet_manager.cc:1397] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.062s user 0.016s sys 0.012s
I20260812 19:28:09.655447 11917 tablet_bootstrap.cc:492] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:09.661123 11917 tablet_bootstrap.cc:654] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
W20260812 19:28:09.662336 11503 tablet.cc:2369] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 19:28:09.675853 11116 master_service.cc:946] ReplaceTablet: received request to replace tablet 8aecdd597baa47cfa84313b07cb9e450 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:09.681547 11922 raft_consensus.cc:348] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.682314 11922 raft_consensus.cc:374] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.682588 11922 raft_consensus.cc:729] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.683653 11925 ts_tablet_manager.cc:1918] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:09.683264 11922 consensus_queue.cc:260] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.685735 11930 raft_consensus.cc:482] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:09.686295 11930 raft_consensus.cc:504] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.694618 11930 leader_election.cc:288] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:09.706261 11116 master_service.cc:946] ReplaceTablet: received request to replace tablet 8aecdd597baa47cfa84313b07cb9e450 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:09.714566 11922 ts_tablet_manager.cc:1428] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.067s user 0.006s sys 0.001s
I20260812 19:28:09.715674 11922 tablet_bootstrap.cc:492] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:09.718493 11925 log.cc:1196] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/8aecdd597baa47cfa84313b07cb9e450
I20260812 19:28:09.719591 11925 ts_tablet_manager.cc:1939] T 8aecdd597baa47cfa84313b07cb9e450 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:09.723084 11917 tablet_bootstrap.cc:492] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:09.723515 11917 ts_tablet_manager.cc:1397] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.068s user 0.013s sys 0.011s
I20260812 19:28:09.726617 11917 raft_consensus.cc:348] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } }
I20260812 19:28:09.727315 11917 raft_consensus.cc:374] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.727594 11917 raft_consensus.cc:729] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.728480 11917 consensus_queue.cc:260] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } }
I20260812 19:28:09.734185 11917 ts_tablet_manager.cc:1428] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260812 19:28:09.735044 11917 tablet_bootstrap.cc:492] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:09.737106 11110 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 8aecdd597baa47cfa84313b07cb9e450 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:09.737494 11922 tablet_bootstrap.cc:654] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.744055 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 8aecdd597baa47cfa84313b07cb9e450 with delete_type TABLET_DATA_DELETED (replaced by tablet 240122ac351f49d3bf225725b270a1d2) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:09.745055 11928 tablet_replica.cc:330] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:09.745829 11928 raft_consensus.cc:2229] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:09.746284 11928 raft_consensus.cc:2258] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:09.749346 11928 ts_tablet_manager.cc:1905] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:09.765640 11917 tablet_bootstrap.cc:654] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.766548 11939 raft_consensus.cc:482] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:09.767100 11939 raft_consensus.cc:504] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.769086 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a0a8245a8d4ae68fddedb3c3ec357e" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" is_pre_election: true
I20260812 19:28:09.770191 11612 raft_consensus.cc:2454] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 0.
I20260812 19:28:09.771422 11939 leader_election.cc:288] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:09.773907 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a0a8245a8d4ae68fddedb3c3ec357e" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:09.774732 11447 raft_consensus.cc:2454] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 0.
I20260812 19:28:09.776551 11725 leader_election.cc:302] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:09.777848 11930 raft_consensus.cc:2781] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:09.778208 11930 raft_consensus.cc:482] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:09.778524 11930 raft_consensus.cc:3037] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Advancing to term 1
19:28:09.787 [HMS - ERROR - pool-6-thread-2] (RetryingHMSHandler.java:201) AlreadyExistsException(message:Table hive.default.table_790d8e4400e84a078b13df4b7b4c6ed5 already exists)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1839)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1786)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:2035)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:147)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:108)
at com.sun.proxy.$Proxy25.create_table_with_environment_context(Unknown Source)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14800)
at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:14784)
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:104)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
I20260812 19:28:09.787935 11922 tablet_bootstrap.cc:492] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:09.788434 11922 ts_tablet_manager.cc:1397] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.073s user 0.016s sys 0.001s
W20260812 19:28:09.793236 11124 catalog_manager.cc:2144] Already present: failed to create HMS catalog entry for table [id=87d58d14b5044caca7c21c26f4d8c6e1]: failed to create Hive MetaStore table: TException - service has thrown: AlreadyExistsException(message=Table hive.default.table_790d8e4400e84a078b13df4b7b4c6ed5 already exists)
I20260812 19:28:09.794142 11124 rpcz_store.cc:275] Call kudu.master.MasterService.CreateTable from 127.0.0.1:53200 (request call id 17) took 1084 ms. Trace:
I20260812 19:28:09.794834 11930 raft_consensus.cc:504] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.794466 11124 rpcz_store.cc:276] 0812 19:28:08.709436 (+ 0us) service_pool.cc:170] Inserting onto call queue
0812 19:28:08.709764 (+ 328us) service_pool.cc:227] Handling call
0812 19:28:08.732959 (+ 23195us) catalog_manager.cc:2075] Acquired catalog manager lock
0812 19:28:08.743905 (+ 10946us) catalog_manager.cc:2121] Created new table and tablet info
0812 19:28:09.794063 (+1050158us) inbound_call.cc:173] Queueing success response
Metrics: {"Hive Metastore.queue_time_us":525544,"Hive Metastore.run_cpu_time_us":2678,"Hive Metastore.run_wall_time_us":522813,"mutex_wait_us":4307,"spinlock_wait_cycles":270464}
I20260812 19:28:09.795435 11922 raft_consensus.cc:348] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.796128 11922 raft_consensus.cc:374] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.796447 11922 raft_consensus.cc:729] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.799854 11124 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53200:
name: "default.Table_5ae6dd5fee2147feaddc748713fd148c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:09.809659 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a0a8245a8d4ae68fddedb3c3ec357e" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110"
I20260812 19:28:09.797186 11922 consensus_queue.cc:260] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.812652 11922 ts_tablet_manager.cc:1428] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.024s user 0.007s sys 0.000s
I20260812 19:28:09.815361 11447 raft_consensus.cc:3037] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Advancing to term 1
F20260812 19:28:09.823113 11300 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_790d8e4400e84a078b13df4b7b4c6ed5
*** Check failure stack trace: ***
I20260812 19:28:09.838375 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a0a8245a8d4ae68fddedb3c3ec357e" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
I20260812 19:28:09.838972 11612 raft_consensus.cc:3037] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:09.848775 11612 raft_consensus.cc:2454] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 1.
I20260812 19:28:09.850091 11724 leader_election.cc:302] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 1d029ad126b9436aa9f4a1c9e1b6b18a; no voters:
I20260812 19:28:09.867815 11930 leader_election.cc:288] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:09.836170 11447 raft_consensus.cc:2454] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 1.
I20260812 19:28:09.857383 11950 raft_consensus.cc:2781] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:09.885883 11116 master_service.cc:946] ReplaceTablet: received request to replace tablet 240122ac351f49d3bf225725b270a1d2 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:09.888780 11917 tablet_bootstrap.cc:492] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:09.889202 11917 ts_tablet_manager.cc:1397] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.154s user 0.019s sys 0.056s
I20260812 19:28:09.889591 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a0a8245a8d4ae68fddedb3c3ec357e" candidate_uuid: "7ae3a240f89541df8f79c381ff857110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" is_pre_election: true
I20260812 19:28:09.890419 11612 raft_consensus.cc:2379] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ae3a240f89541df8f79c381ff857110 in current term 1: Already voted for candidate 1cc50828dde64ba6a456762a258fc744 in this term.
I20260812 19:28:09.891558 11917 raft_consensus.cc:348] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.892232 11917 raft_consensus.cc:374] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.892529 11917 raft_consensus.cc:729] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.897394 11928 ts_tablet_manager.cc:1918] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:09.897828 11928 log.cc:1196] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/8aecdd597baa47cfa84313b07cb9e450
I20260812 19:28:09.900245 11928 ts_tablet_manager.cc:1939] T 8aecdd597baa47cfa84313b07cb9e450 P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:09.900425 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23a0a8245a8d4ae68fddedb3c3ec357e" candidate_uuid: "7ae3a240f89541df8f79c381ff857110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
I20260812 19:28:09.902257 11950 raft_consensus.cc:686] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 1 LEADER]: Becoming Leader. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Running, Role: LEADER
I20260812 19:28:09.903501 11111 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet 8aecdd597baa47cfa84313b07cb9e450 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:09.904372 11917 consensus_queue.cc:260] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.907830 11917 ts_tablet_manager.cc:1428] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.018s user 0.002s sys 0.004s
I20260812 19:28:09.908694 11917 tablet_bootstrap.cc:492] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:09.903678 11950 consensus_queue.cc:237] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.914223 11917 tablet_bootstrap.cc:654] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:09.921728 11117 master_service.cc:946] ReplaceTablet: received request to replace tablet 68d708b92b844bcaa3051f337e6ac94a from {username='slave'} at 127.0.0.1:53200
@ 0x7f255dbbb9a0 google::LogMessage::Flush() at ??:0
I20260812 19:28:09.937824 11917 tablet_bootstrap.cc:492] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:09.947198 11917 ts_tablet_manager.cc:1397] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.039s user 0.007s sys 0.008s
I20260812 19:28:09.949756 11917 raft_consensus.cc:348] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.950431 11917 raft_consensus.cc:374] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:09.950680 11917 raft_consensus.cc:729] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:09.955265 11917 consensus_queue.cc:260] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:09.961886 11917 ts_tablet_manager.cc:1428] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260812 19:28:09.969729 11116 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Sending DeleteTablet for 3 replicas of tablet 240122ac351f49d3bf225725b270a1d2
I20260812 19:28:09.971148 11116 catalog_manager.cc:6565] ReplaceTablet: tablet 240122ac351f49d3bf225725b270a1d2 deleted and replaced by tablet 01173649a54948e69a8c67d552675413
I20260812 19:28:09.973294 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 240122ac351f49d3bf225725b270a1d2 with delete_type TABLET_DATA_DELETED (replaced by tablet 01173649a54948e69a8c67d552675413) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:09.974000 11928 tablet_replica.cc:330] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:09.974123 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 240122ac351f49d3bf225725b270a1d2 with delete_type TABLET_DATA_DELETED (replaced by tablet 01173649a54948e69a8c67d552675413) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:09.974743 11928 raft_consensus.cc:2229] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:09.974994 11775 tablet_service.cc:1514] Processing DeleteTablet for tablet 240122ac351f49d3bf225725b270a1d2 with delete_type TABLET_DATA_DELETED (replaced by tablet 01173649a54948e69a8c67d552675413) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:09.975196 11928 raft_consensus.cc:2258] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:09.975782 11925 tablet_replica.cc:330] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:09.976558 11925 raft_consensus.cc:2229] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:09.977002 11925 raft_consensus.cc:2258] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:09.977484 11928 ts_tablet_manager.cc:1905] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:09.983162 11925 ts_tablet_manager.cc:1905] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:09.988287 11926 tablet_replica.cc:330] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:09.989104 11926 raft_consensus.cc:2229] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:09.989596 11926 raft_consensus.cc:2258] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus is shut down!
@ 0x7f255dbbb70f google::LogMessage::~LogMessage() at ??:0
I20260812 19:28:09.991772 11926 ts_tablet_manager.cc:1905] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:09.993352 11373 leader_election.cc:302] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ae3a240f89541df8f79c381ff857110; no voters: 1cc50828dde64ba6a456762a258fc744, 1d029ad126b9436aa9f4a1c9e1b6b18a
I20260812 19:28:09.994751 11939 raft_consensus.cc:2726] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:28:09.999874 11928 ts_tablet_manager.cc:1918] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.012073 11926 ts_tablet_manager.cc:1918] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.012229 11928 log.cc:1196] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/240122ac351f49d3bf225725b270a1d2
I20260812 19:28:10.012595 11926 log.cc:1196] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/240122ac351f49d3bf225725b270a1d2
I20260812 19:28:10.013015 11928 ts_tablet_manager.cc:1939] T 240122ac351f49d3bf225725b270a1d2 P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:10.013257 11926 ts_tablet_manager.cc:1939] T 240122ac351f49d3bf225725b270a1d2 P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:10.020440 11109 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet 240122ac351f49d3bf225725b270a1d2 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:10.021219 11111 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet 240122ac351f49d3bf225725b270a1d2 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:10.034977 11117 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Sending DeleteTablet for 3 replicas of tablet 68d708b92b844bcaa3051f337e6ac94a
I20260812 19:28:10.036729 11117 catalog_manager.cc:6565] ReplaceTablet: tablet 68d708b92b844bcaa3051f337e6ac94a deleted and replaced by tablet 94b095941bbd495c99408704be7cc427
I20260812 19:28:10.038304 11116 catalog_manager.cc:5495] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1cc50828dde64ba6a456762a258fc744 (127.7.144.195). New cstate: current_term: 1 leader_uuid: "1cc50828dde64ba6a456762a258fc744" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } health_report { overall_health: HEALTHY } } }
I20260812 19:28:10.041056 11775 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d708b92b844bcaa3051f337e6ac94a with delete_type TABLET_DATA_DELETED (replaced by tablet 94b095941bbd495c99408704be7cc427) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:10.042448 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d708b92b844bcaa3051f337e6ac94a with delete_type TABLET_DATA_DELETED (replaced by tablet 94b095941bbd495c99408704be7cc427) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:10.042865 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 68d708b92b844bcaa3051f337e6ac94a with delete_type TABLET_DATA_DELETED (replaced by tablet 94b095941bbd495c99408704be7cc427) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:10.043191 11928 tablet_replica.cc:330] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:10.043902 11928 raft_consensus.cc:2229] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.044377 11928 raft_consensus.cc:2258] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.044875 11926 tablet_replica.cc:330] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:10.045596 11926 raft_consensus.cc:2229] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.046057 11926 raft_consensus.cc:2258] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.046625 11928 ts_tablet_manager.cc:1905] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.058145 11925 ts_tablet_manager.cc:1918] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.058648 11925 log.cc:1196] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/240122ac351f49d3bf225725b270a1d2
I20260812 19:28:10.059433 11925 ts_tablet_manager.cc:1939] T 240122ac351f49d3bf225725b270a1d2 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:10.061913 11926 ts_tablet_manager.cc:1905] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.067607 11928 ts_tablet_manager.cc:1918] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.070783 11928 log.cc:1196] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/68d708b92b844bcaa3051f337e6ac94a
I20260812 19:28:10.071451 11928 ts_tablet_manager.cc:1939] T 68d708b92b844bcaa3051f337e6ac94a P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:10.072070 11110 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 240122ac351f49d3bf225725b270a1d2 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:10.075243 11925 tablet_replica.cc:330] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
@ 0x7f2568c4aaea kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260812 19:28:10.081687 11925 raft_consensus.cc:2229] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.082230 11925 raft_consensus.cc:2258] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.084569 11925 ts_tablet_manager.cc:1905] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.095297 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 240122ac351f49d3bf225725b270a1d2 with delete_type TABLET_DATA_DELETED (replaced by tablet 01173649a54948e69a8c67d552675413) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:10.099509 11926 ts_tablet_manager.cc:1918] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.099910 11926 log.cc:1196] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/68d708b92b844bcaa3051f337e6ac94a
I20260812 19:28:10.112229 11926 ts_tablet_manager.cc:1939] T 68d708b92b844bcaa3051f337e6ac94a P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:10.114965 11109 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet 68d708b92b844bcaa3051f337e6ac94a (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
I20260812 19:28:10.129180 11925 ts_tablet_manager.cc:1918] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.134918 11925 log.cc:1196] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/68d708b92b844bcaa3051f337e6ac94a
I20260812 19:28:10.135601 11925 ts_tablet_manager.cc:1939] T 68d708b92b844bcaa3051f337e6ac94a P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:10.140607 11110 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 68d708b92b844bcaa3051f337e6ac94a (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
I20260812 19:28:10.143481 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 94b095941bbd495c99408704be7cc427 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.144564 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94b095941bbd495c99408704be7cc427. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f2568c4a33c kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260812 19:28:10.157613 11589 tablet_service.cc:1467] Processing CreateTablet for tablet 94b095941bbd495c99408704be7cc427 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.158016 11775 tablet_service.cc:1467] Processing CreateTablet for tablet 94b095941bbd495c99408704be7cc427 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.158681 11589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94b095941bbd495c99408704be7cc427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.159096 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94b095941bbd495c99408704be7cc427. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.171541 11423 tablet_service.cc:1467] Processing CreateTablet for tablet 01173649a54948e69a8c67d552675413 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.172724 11423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01173649a54948e69a8c67d552675413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.173458 11111 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet 68d708b92b844bcaa3051f337e6ac94a (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
W20260812 19:28:10.175871 11111 catalog_manager.cc:4808] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): delete failed for tablet 240122ac351f49d3bf225725b270a1d2 because the tablet was not found. No further retry: Not found: Tablet not found: 240122ac351f49d3bf225725b270a1d2
I20260812 19:28:10.177035 11590 tablet_service.cc:1467] Processing CreateTablet for tablet 01173649a54948e69a8c67d552675413 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.178094 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01173649a54948e69a8c67d552675413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.178567 11774 tablet_service.cc:1467] Processing CreateTablet for tablet 01173649a54948e69a8c67d552675413 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.179558 11774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01173649a54948e69a8c67d552675413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.188427 11922 tablet_bootstrap.cc:492] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:10.194617 11922 tablet_bootstrap.cc:654] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.200703 11121 master_service.cc:946] ReplaceTablet: received request to replace tablet 23a0a8245a8d4ae68fddedb3c3ec357e from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:10.202119 11922 tablet_bootstrap.cc:492] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:10.202502 11922 ts_tablet_manager.cc:1397] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260812 19:28:10.204859 11922 raft_consensus.cc:348] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.206918 11922 raft_consensus.cc:374] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.207226 11922 raft_consensus.cc:729] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
@ 0x7f2568c4dfd2 kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260812 19:28:10.210906 11922 consensus_queue.cc:260] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.217842 11922 ts_tablet_manager.cc:1428] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20260812 19:28:10.222220 11917 tablet_bootstrap.cc:492] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:10.228094 11917 tablet_bootstrap.cc:654] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.233700 11121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Sending DeleteTablet for 3 replicas of tablet 23a0a8245a8d4ae68fddedb3c3ec357e
I20260812 19:28:10.236198 11424 tablet_service.cc:1514] Processing DeleteTablet for tablet 23a0a8245a8d4ae68fddedb3c3ec357e with delete_type TABLET_DATA_DELETED (replaced by tablet 5f0828c3f81148008a7b6289053f2147) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:10.236984 11928 tablet_replica.cc:330] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:10.237663 11928 raft_consensus.cc:2229] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.238149 11121 catalog_manager.cc:6565] ReplaceTablet: tablet 23a0a8245a8d4ae68fddedb3c3ec357e deleted and replaced by tablet 5f0828c3f81148008a7b6289053f2147
I20260812 19:28:10.238111 11928 raft_consensus.cc:2258] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.238675 11590 tablet_service.cc:1514] Processing DeleteTablet for tablet 23a0a8245a8d4ae68fddedb3c3ec357e with delete_type TABLET_DATA_DELETED (replaced by tablet 5f0828c3f81148008a7b6289053f2147) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:10.239365 11925 tablet_replica.cc:330] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:10.239914 11928 ts_tablet_manager.cc:1905] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.240021 11925 raft_consensus.cc:2229] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.241047 11925 raft_consensus.cc:2258] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.242306 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet 23a0a8245a8d4ae68fddedb3c3ec357e with delete_type TABLET_DATA_DELETED (replaced by tablet 5f0828c3f81148008a7b6289053f2147) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:10.243036 11925 ts_tablet_manager.cc:1905] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.243230 11926 tablet_replica.cc:330] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:10.243867 11926 raft_consensus.cc:2229] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:28:10.247032 11926 pending_rounds.cc:62] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Trying to abort 1 pending ops.
I20260812 19:28:10.247282 11926 pending_rounds.cc:68] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7317761597149450240 op_type: NO_OP noop_request { }
I20260812 19:28:10.247771 11926 raft_consensus.cc:2866] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 19:28:10.248159 11926 raft_consensus.cc:2258] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.252748 11121 master_service.cc:946] ReplaceTablet: received request to replace tablet 01173649a54948e69a8c67d552675413 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:10.253437 11967 tablet_bootstrap.cc:492] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:10.253895 11926 ts_tablet_manager.cc:1905] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.263729 11922 tablet_bootstrap.cc:492] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:10.266228 11928 ts_tablet_manager.cc:1918] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.266644 11928 log.cc:1196] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/23a0a8245a8d4ae68fddedb3c3ec357e
I20260812 19:28:10.267285 11928 ts_tablet_manager.cc:1939] T 23a0a8245a8d4ae68fddedb3c3ec357e P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:10.269606 11922 tablet_bootstrap.cc:654] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.260068 11967 tablet_bootstrap.cc:654] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.278654 11917 tablet_bootstrap.cc:492] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:10.279084 11917 ts_tablet_manager.cc:1397] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.057s user 0.005s sys 0.018s
I20260812 19:28:10.281627 11917 raft_consensus.cc:348] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.282346 11917 raft_consensus.cc:374] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.282613 11917 raft_consensus.cc:729] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.282716 11926 ts_tablet_manager.cc:1918] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:10.283102 11926 log.cc:1196] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/23a0a8245a8d4ae68fddedb3c3ec357e
I20260812 19:28:10.283855 11926 ts_tablet_manager.cc:1939] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:10.284329 11111 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet 23a0a8245a8d4ae68fddedb3c3ec357e (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]) successfully deleted
I20260812 19:28:10.287528 11967 tablet_bootstrap.cc:492] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:10.287935 11967 ts_tablet_manager.cc:1397] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.000s
I20260812 19:28:10.289827 11925 ts_tablet_manager.cc:1918] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.290481 11967 raft_consensus.cc:348] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.290904 11925 log.cc:1196] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/23a0a8245a8d4ae68fddedb3c3ec357e
I20260812 19:28:10.291160 11967 raft_consensus.cc:374] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.291428 11967 raft_consensus.cc:729] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.291712 11925 ts_tablet_manager.cc:1939] T 23a0a8245a8d4ae68fddedb3c3ec357e P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:10.292176 11917 consensus_queue.cc:260] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.296906 11775 tablet_service.cc:1467] Processing CreateTablet for tablet 5f0828c3f81148008a7b6289053f2147 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.297165 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 5f0828c3f81148008a7b6289053f2147 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.297467 11590 tablet_service.cc:1467] Processing CreateTablet for tablet 5f0828c3f81148008a7b6289053f2147 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.298026 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f0828c3f81148008a7b6289053f2147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.298511 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f0828c3f81148008a7b6289053f2147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.298870 11917 ts_tablet_manager.cc:1428] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.020s user 0.004s sys 0.004s
I20260812 19:28:10.300012 11967 consensus_queue.cc:260] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.302045 11967 ts_tablet_manager.cc:1428] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20260812 19:28:10.302860 11967 tablet_bootstrap.cc:492] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
@ 0x7f2568c4df8a _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
I20260812 19:28:10.309257 11967 tablet_bootstrap.cc:654] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.312027 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5f0828c3f81148008a7b6289053f2147. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.312197 11109 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet 23a0a8245a8d4ae68fddedb3c3ec357e (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]) successfully deleted
I20260812 19:28:10.318038 11917 tablet_bootstrap.cc:492] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:10.326026 11917 tablet_bootstrap.cc:654] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.338682 11423 tablet_service.cc:1514] Processing DeleteTablet for tablet 01173649a54948e69a8c67d552675413 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ef533fcc4a415396ac0784e0b73e3c) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:10.339509 11928 tablet_replica.cc:330] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:10.340221 11928 raft_consensus.cc:2229] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.340911 11928 raft_consensus.cc:2258] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.341298 11121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Sending DeleteTablet for 3 replicas of tablet 01173649a54948e69a8c67d552675413
I20260812 19:28:10.343102 11928 ts_tablet_manager.cc:1905] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.343215 11423 tablet_service.cc:1514] Processing DeleteTablet for tablet 01173649a54948e69a8c67d552675413 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ef533fcc4a415396ac0784e0b73e3c) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:10.344908 11121 catalog_manager.cc:6565] ReplaceTablet: tablet 01173649a54948e69a8c67d552675413 deleted and replaced by tablet 53ef533fcc4a415396ac0784e0b73e3c
I20260812 19:28:10.345414 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 01173649a54948e69a8c67d552675413 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ef533fcc4a415396ac0784e0b73e3c) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:10.347330 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet 01173649a54948e69a8c67d552675413 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ef533fcc4a415396ac0784e0b73e3c) from {username='slave'} at 127.0.0.1:38948
W20260812 19:28:10.348995 11109 catalog_manager.cc:4821] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): delete failed for tablet 01173649a54948e69a8c67d552675413 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01173649a54948e69a8c67d552675413 already in progress: creating tablet
I20260812 19:28:10.352430 11967 tablet_bootstrap.cc:492] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:10.353104 11967 ts_tablet_manager.cc:1397] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.050s user 0.004s sys 0.011s
I20260812 19:28:10.355602 11967 raft_consensus.cc:348] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.356312 11967 raft_consensus.cc:374] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.356591 11967 raft_consensus.cc:729] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.357206 11967 consensus_queue.cc:260] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.359190 11967 ts_tablet_manager.cc:1428] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260812 19:28:10.365173 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet 01173649a54948e69a8c67d552675413 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ef533fcc4a415396ac0784e0b73e3c) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:10.365842 11926 tablet_replica.cc:330] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:10.366542 11926 raft_consensus.cc:2229] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.366976 11926 raft_consensus.cc:2258] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.369226 11926 ts_tablet_manager.cc:1905] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7f2568c4df1a std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260812 19:28:10.376976 11110 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 23a0a8245a8d4ae68fddedb3c3ec357e (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]) successfully deleted
I20260812 19:28:10.377972 11922 tablet_bootstrap.cc:492] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:10.378427 11922 ts_tablet_manager.cc:1397] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.115s user 0.006s sys 0.003s
W20260812 19:28:10.378950 11110 catalog_manager.cc:4821] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): delete failed for tablet 01173649a54948e69a8c67d552675413 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 01173649a54948e69a8c67d552675413 already in progress: creating tablet
I20260812 19:28:10.380903 11922 raft_consensus.cc:348] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.381618 11922 raft_consensus.cc:374] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.381873 11922 raft_consensus.cc:729] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.382534 11922 consensus_queue.cc:260] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.384631 11922 ts_tablet_manager.cc:1428] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20260812 19:28:10.387686 11932 raft_consensus.cc:482] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:10.388128 11932 raft_consensus.cc:504] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.394407 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 01173649a54948e69a8c67d552675413 with delete_type TABLET_DATA_DELETED (replaced by tablet 53ef533fcc4a415396ac0784e0b73e3c) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:10.394670 11917 tablet_bootstrap.cc:492] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:10.397274 11589 tablet_service.cc:1467] Processing CreateTablet for tablet 53ef533fcc4a415396ac0784e0b73e3c (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.398332 11589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ef533fcc4a415396ac0784e0b73e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.400398 11922 tablet_bootstrap.cc:492] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:10.401350 11774 tablet_service.cc:1467] Processing CreateTablet for tablet 53ef533fcc4a415396ac0784e0b73e3c (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.402406 11774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ef533fcc4a415396ac0784e0b73e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.395120 11917 ts_tablet_manager.cc:1397] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.077s user 0.030s sys 0.006s
I20260812 19:28:10.406869 11922 tablet_bootstrap.cc:654] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.406996 11925 tablet_replica.cc:330] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:10.407687 11925 raft_consensus.cc:2229] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.408160 11925 raft_consensus.cc:2258] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.409193 11928 ts_tablet_manager.cc:1918] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.409580 11928 log.cc:1196] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/01173649a54948e69a8c67d552675413
I20260812 19:28:10.410250 11928 ts_tablet_manager.cc:1939] T 01173649a54948e69a8c67d552675413 P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:10.411459 11967 tablet_bootstrap.cc:492] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:10.416137 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 53ef533fcc4a415396ac0784e0b73e3c (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.417291 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ef533fcc4a415396ac0784e0b73e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.416846 11917 raft_consensus.cc:348] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.417588 11917 raft_consensus.cc:374] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.417876 11917 raft_consensus.cc:729] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.418969 11932 leader_election.cc:288] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:10.420800 11917 consensus_queue.cc:260] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.422566 11925 ts_tablet_manager.cc:1905] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.427742 11111 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet 01173649a54948e69a8c67d552675413 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:10.429385 11967 tablet_bootstrap.cc:654] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.429771 11917 ts_tablet_manager.cc:1428] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.025s user 0.003s sys 0.003s
I20260812 19:28:10.430644 11917 tablet_bootstrap.cc:492] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:10.445461 11121 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f0828c3f81148008a7b6289053f2147 from {username='slave'} at 127.0.0.1:53200
W20260812 19:28:10.446563 11111 catalog_manager.cc:4808] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): delete failed for tablet 01173649a54948e69a8c67d552675413 because the tablet was not found. No further retry: Not found: Tablet not found: 01173649a54948e69a8c67d552675413
I20260812 19:28:10.452639 11967 tablet_bootstrap.cc:492] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:10.453168 11967 ts_tablet_manager.cc:1397] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.006s
I20260812 19:28:10.454324 11917 tablet_bootstrap.cc:654] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.456513 11967 raft_consensus.cc:348] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.457194 11967 raft_consensus.cc:374] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.457468 11967 raft_consensus.cc:729] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
W20260812 19:28:10.458339 11539 leader_election.cc:341] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): Not found: Tablet not found: 01173649a54948e69a8c67d552675413
@ 0x7f2568c4dee2 std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260812 19:28:10.467310 11922 tablet_bootstrap.cc:492] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:10.467742 11922 ts_tablet_manager.cc:1397] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.068s user 0.002s sys 0.007s
I20260812 19:28:10.469817 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01173649a54948e69a8c67d552675413" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
I20260812 19:28:10.470152 11922 raft_consensus.cc:348] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.470796 11922 raft_consensus.cc:374] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.471041 11922 raft_consensus.cc:729] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.471623 11922 consensus_queue.cc:260] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.458081 11967 consensus_queue.cc:260] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
W20260812 19:28:10.473011 11536 leader_election.cc:341] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): Illegal state: Tablet not RUNNING: STOPPED
I20260812 19:28:10.473467 11536 leader_election.cc:302] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a; no voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110
W20260812 19:28:10.474176 11536 raft_consensus.cc:2670] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260812 19:28:10.472986 11925 ts_tablet_manager.cc:1918] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.475230 11925 log.cc:1196] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/01173649a54948e69a8c67d552675413
I20260812 19:28:10.476102 11925 ts_tablet_manager.cc:1939] T 01173649a54948e69a8c67d552675413 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:10.479866 11110 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 01173649a54948e69a8c67d552675413 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:10.482280 11967 ts_tablet_manager.cc:1428] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.029s user 0.006s sys 0.000s
I20260812 19:28:10.484128 11922 ts_tablet_manager.cc:1428] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20260812 19:28:10.484995 11922 tablet_bootstrap.cc:492] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:10.491194 11922 tablet_bootstrap.cc:654] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.505457 11775 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0828c3f81148008a7b6289053f2147 with delete_type TABLET_DATA_DELETED (replaced by tablet c3df30578cb841a290855c251455f3d9) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:10.509128 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0828c3f81148008a7b6289053f2147 with delete_type TABLET_DATA_DELETED (replaced by tablet c3df30578cb841a290855c251455f3d9) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:10.509907 11925 tablet_replica.cc:330] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:10.510624 11925 raft_consensus.cc:2229] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.511109 11925 raft_consensus.cc:2258] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.513486 11925 ts_tablet_manager.cc:1905] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.533625 11925 ts_tablet_manager.cc:1918] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.534503 11121 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Sending DeleteTablet for 3 replicas of tablet 5f0828c3f81148008a7b6289053f2147
I20260812 19:28:10.536384 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0828c3f81148008a7b6289053f2147 with delete_type TABLET_DATA_DELETED (replaced by tablet c3df30578cb841a290855c251455f3d9) from {username='slave'} at 127.0.0.1:54630
W20260812 19:28:10.538748 11111 catalog_manager.cc:4821] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): delete failed for tablet 5f0828c3f81148008a7b6289053f2147 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet 5f0828c3f81148008a7b6289053f2147 already in progress: creating tablet
I20260812 19:28:10.534046 11925 log.cc:1196] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/5f0828c3f81148008a7b6289053f2147
I20260812 19:28:10.539978 11925 ts_tablet_manager.cc:1939] T 5f0828c3f81148008a7b6289053f2147 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:10.541540 11422 tablet_service.cc:1467] Processing CreateTablet for tablet c3df30578cb841a290855c251455f3d9 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.542398 11589 tablet_service.cc:1467] Processing CreateTablet for tablet c3df30578cb841a290855c251455f3d9 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.542976 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3df30578cb841a290855c251455f3d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.543476 11589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3df30578cb841a290855c251455f3d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.546339 11590 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0828c3f81148008a7b6289053f2147 with delete_type TABLET_DATA_DELETED (replaced by tablet c3df30578cb841a290855c251455f3d9) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:10.547098 11775 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0828c3f81148008a7b6289053f2147 with delete_type TABLET_DATA_DELETED (replaced by tablet c3df30578cb841a290855c251455f3d9) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:10.551891 11121 catalog_manager.cc:6565] ReplaceTablet: tablet 5f0828c3f81148008a7b6289053f2147 deleted and replaced by tablet c3df30578cb841a290855c251455f3d9
I20260812 19:28:10.554075 11117 master_service.cc:946] ReplaceTablet: received request to replace tablet 94b095941bbd495c99408704be7cc427 from {username='slave'} at 127.0.0.1:53200
I20260812 19:28:10.553974 11775 tablet_service.cc:1467] Processing CreateTablet for tablet c3df30578cb841a290855c251455f3d9 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.555099 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3df30578cb841a290855c251455f3d9. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7f2568c4d1de std::__1::__function::__func<>::operator()() at ??:0
@ 0x580785 std::__1::__function::__value_func<>::operator()() at ??:?
I20260812 19:28:10.573210 11110 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 5f0828c3f81148008a7b6289053f2147 (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]) successfully deleted
W20260812 19:28:10.576879 11110 catalog_manager.cc:4808] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): delete failed for tablet 5f0828c3f81148008a7b6289053f2147 because the tablet was not found. No further retry: Not found: Tablet not found: 5f0828c3f81148008a7b6289053f2147
I20260812 19:28:10.578847 11117 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c0ebc7fa78c6461fb1baa698aaf99ee4: Sending DeleteTablet for 3 replicas of tablet 94b095941bbd495c99408704be7cc427
I20260812 19:28:10.580658 11423 tablet_service.cc:1514] Processing DeleteTablet for tablet 94b095941bbd495c99408704be7cc427 with delete_type TABLET_DATA_DELETED (replaced by tablet bfadc0f92e8e4cdcbd893b44ca73a65d) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:10.581569 11928 tablet_replica.cc:330] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:10.582305 11928 raft_consensus.cc:2229] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.582878 11928 raft_consensus.cc:2258] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.583168 11117 catalog_manager.cc:6565] ReplaceTablet: tablet 94b095941bbd495c99408704be7cc427 deleted and replaced by tablet bfadc0f92e8e4cdcbd893b44ca73a65d
I20260812 19:28:10.583330 11590 tablet_service.cc:1514] Processing DeleteTablet for tablet 94b095941bbd495c99408704be7cc427 with delete_type TABLET_DATA_DELETED (replaced by tablet bfadc0f92e8e4cdcbd893b44ca73a65d) from {username='slave'} at 127.0.0.1:49978
I20260812 19:28:10.584951 11772 tablet_service.cc:1514] Processing DeleteTablet for tablet 94b095941bbd495c99408704be7cc427 with delete_type TABLET_DATA_DELETED (replaced by tablet bfadc0f92e8e4cdcbd893b44ca73a65d) from {username='slave'} at 127.0.0.1:38948
I20260812 19:28:10.585421 11926 ts_tablet_manager.cc:1918] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.585638 11928 ts_tablet_manager.cc:1905] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.585717 11925 tablet_replica.cc:330] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:10.585832 11926 log.cc:1196] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/01173649a54948e69a8c67d552675413
I20260812 19:28:10.586426 11925 raft_consensus.cc:2229] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.586517 11926 ts_tablet_manager.cc:1939] T 01173649a54948e69a8c67d552675413 P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:10.586876 11925 raft_consensus.cc:2258] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.589286 11967 tablet_bootstrap.cc:492] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:10.592397 11925 ts_tablet_manager.cc:1905] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.595865 11967 tablet_bootstrap.cc:654] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.598237 11917 tablet_bootstrap.cc:492] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:10.598706 11917 ts_tablet_manager.cc:1397] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.168s user 0.020s sys 0.014s
I20260812 19:28:10.605440 11109 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet 01173649a54948e69a8c67d552675413 (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:10.605225 11917 raft_consensus.cc:348] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.605978 11917 raft_consensus.cc:374] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.606047 11967 tablet_bootstrap.cc:492] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:10.606452 11967 ts_tablet_manager.cc:1397] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.017s user 0.009s sys 0.000s
I20260812 19:28:10.606246 11917 raft_consensus.cc:729] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.609493 11967 raft_consensus.cc:348] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.610179 11967 raft_consensus.cc:374] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.610430 11967 raft_consensus.cc:729] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.611188 11917 consensus_queue.cc:260] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.611191 11967 consensus_queue.cc:260] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.615238 11926 tablet_replica.cc:330] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:10.615649 11967 ts_tablet_manager.cc:1428] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.009s user 0.003s sys 0.005s
I20260812 19:28:10.615999 11926 raft_consensus.cc:2229] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.616508 11926 raft_consensus.cc:2258] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.620975 11922 tablet_bootstrap.cc:492] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:10.621379 11922 ts_tablet_manager.cc:1397] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.137s user 0.046s sys 0.059s
I20260812 19:28:10.622465 11926 ts_tablet_manager.cc:1905] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.618237 11967 tablet_bootstrap.cc:492] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:10.623654 11922 raft_consensus.cc:348] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.627825 11922 raft_consensus.cc:374] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.628089 11922 raft_consensus.cc:729] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.628741 11922 consensus_queue.cc:260] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.630508 11922 ts_tablet_manager.cc:1428] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
@ 0x5805ba std::__1::function<>::operator()() at ??:?
I20260812 19:28:10.636294 11967 tablet_bootstrap.cc:654] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.638137 11939 raft_consensus.cc:482] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:10.638576 11939 raft_consensus.cc:504] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.640435 11922 tablet_bootstrap.cc:492] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:10.640432 11939 leader_election.cc:288] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:10.642185 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5f0828c3f81148008a7b6289053f2147" candidate_uuid: "7ae3a240f89541df8f79c381ff857110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
W20260812 19:28:10.643673 11374 leader_election.cc:341] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): Not found: Tablet not found: 5f0828c3f81148008a7b6289053f2147
W20260812 19:28:10.644433 11373 leader_election.cc:341] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): Illegal state: Tablet not RUNNING: STOPPED
I20260812 19:28:10.644805 11373 leader_election.cc:302] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ae3a240f89541df8f79c381ff857110; no voters: 1cc50828dde64ba6a456762a258fc744, 1d029ad126b9436aa9f4a1c9e1b6b18a
I20260812 19:28:10.645804 11939 raft_consensus.cc:2726] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:28:10.646500 11922 tablet_bootstrap.cc:654] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.646849 11917 ts_tablet_manager.cc:1428] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.048s user 0.006s sys 0.002s
I20260812 19:28:10.648058 11422 tablet_service.cc:1467] Processing CreateTablet for tablet bfadc0f92e8e4cdcbd893b44ca73a65d (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.649235 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfadc0f92e8e4cdcbd893b44ca73a65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.649492 11589 tablet_service.cc:1467] Processing CreateTablet for tablet bfadc0f92e8e4cdcbd893b44ca73a65d (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.650518 11589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfadc0f92e8e4cdcbd893b44ca73a65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.650650 11967 tablet_bootstrap.cc:492] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:10.651085 11967 ts_tablet_manager.cc:1397] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.034s user 0.009s sys 0.000s
I20260812 19:28:10.653654 11967 raft_consensus.cc:348] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.654383 11967 raft_consensus.cc:374] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.654640 11967 raft_consensus.cc:729] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.654585 11774 tablet_service.cc:1467] Processing CreateTablet for tablet bfadc0f92e8e4cdcbd893b44ca73a65d (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:10.655714 11774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfadc0f92e8e4cdcbd893b44ca73a65d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:10.655661 11967 consensus_queue.cc:260] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.660084 11967 ts_tablet_manager.cc:1428] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20260812 19:28:10.663584 11925 ts_tablet_manager.cc:1918] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.663973 11925 log.cc:1196] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/94b095941bbd495c99408704be7cc427
I20260812 19:28:10.666158 11922 tablet_bootstrap.cc:492] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:10.666549 11922 ts_tablet_manager.cc:1397] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.000s
I20260812 19:28:10.668176 11925 ts_tablet_manager.cc:1939] T 94b095941bbd495c99408704be7cc427 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:10.669883 11423 tablet_service.cc:1514] Processing DeleteTablet for tablet 5f0828c3f81148008a7b6289053f2147 with delete_type TABLET_DATA_DELETED (replaced by tablet c3df30578cb841a290855c251455f3d9) from {username='slave'} at 127.0.0.1:54630
I20260812 19:28:10.669378 11922 raft_consensus.cc:348] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.670281 11922 raft_consensus.cc:374] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.670521 11922 raft_consensus.cc:729] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.670869 11110 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 94b095941bbd495c99408704be7cc427 (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
I20260812 19:28:10.671085 11922 consensus_queue.cc:260] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.676828 11922 ts_tablet_manager.cc:1428] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20260812 19:28:10.677433 11917 tablet_bootstrap.cc:492] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:10.691479 11928 ts_tablet_manager.cc:1918] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.691944 11928 log.cc:1196] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/94b095941bbd495c99408704be7cc427
@ 0x7f255fd6cdc7 kudu::Thread::SuperviseThread() at ??:0
@ 0x4230f0 __tsan_thread_start_func at ??:?
I20260812 19:28:10.702057 11917 tablet_bootstrap.cc:654] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.704222 11922 tablet_bootstrap.cc:492] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:10.713095 11922 tablet_bootstrap.cc:654] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
@ 0x7f25613da6db start_thread at ??:0
I20260812 19:28:10.714160 11967 tablet_bootstrap.cc:492] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:10.720623 11967 tablet_bootstrap.cc:654] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.721089 11928 ts_tablet_manager.cc:1939] T 94b095941bbd495c99408704be7cc427 P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:10.722988 11926 ts_tablet_manager.cc:1918] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.723390 11926 log.cc:1196] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/5f0828c3f81148008a7b6289053f2147
I20260812 19:28:10.724080 11926 ts_tablet_manager.cc:1939] T 5f0828c3f81148008a7b6289053f2147 P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:10.726935 11928 tablet_replica.cc:330] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:10.727149 11111 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet 94b095941bbd495c99408704be7cc427 (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
I20260812 19:28:10.728868 11926 tablet_replica.cc:330] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:10.729660 11926 raft_consensus.cc:2229] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.730114 11926 raft_consensus.cc:2258] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.731117 11109 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet 5f0828c3f81148008a7b6289053f2147 (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]) successfully deleted
I20260812 19:28:10.732568 11967 tablet_bootstrap.cc:492] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
W20260812 19:28:10.731837 11109 catalog_manager.cc:4808] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): delete failed for tablet 5f0828c3f81148008a7b6289053f2147 because the tablet was not found. No further retry: Not found: Tablet not found: 5f0828c3f81148008a7b6289053f2147
I20260812 19:28:10.732964 11967 ts_tablet_manager.cc:1397] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.019s user 0.012s sys 0.005s
I20260812 19:28:10.733174 11926 ts_tablet_manager.cc:1905] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.735608 11967 raft_consensus.cc:348] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.736406 11967 raft_consensus.cc:374] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.736685 11967 raft_consensus.cc:729] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.737527 11967 consensus_queue.cc:260] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
@ 0x7f255c86061f clone at ??:0
I20260812 19:28:10.743541 11967 ts_tablet_manager.cc:1428] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20260812 19:28:10.749054 11922 tablet_bootstrap.cc:492] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:10.749257 11926 ts_tablet_manager.cc:1918] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.749519 11922 ts_tablet_manager.cc:1397] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.000s
I20260812 19:28:10.749660 11926 log.cc:1196] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/94b095941bbd495c99408704be7cc427
I20260812 19:28:10.750324 11926 ts_tablet_manager.cc:1939] T 94b095941bbd495c99408704be7cc427 P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:10.753023 11928 raft_consensus.cc:2229] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:10.753513 11928 raft_consensus.cc:2258] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:10.756449 11917 tablet_bootstrap.cc:492] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:10.756814 11928 ts_tablet_manager.cc:1905] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:10.756827 11917 ts_tablet_manager.cc:1397] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.100s user 0.004s sys 0.006s
I20260812 19:28:10.760411 11922 raft_consensus.cc:348] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.761096 11922 raft_consensus.cc:374] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.761335 11922 raft_consensus.cc:729] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.761098 11917 raft_consensus.cc:348] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.762035 11917 raft_consensus.cc:374] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.762053 11932 raft_consensus.cc:482] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:10.762266 11917 raft_consensus.cc:729] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.761905 11922 consensus_queue.cc:260] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.762455 11932 raft_consensus.cc:504] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.763106 11917 consensus_queue.cc:260] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.764426 11932 leader_election.cc:288] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:10.770157 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ef533fcc4a415396ac0784e0b73e3c" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:10.770754 11447 raft_consensus.cc:2454] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 0.
I20260812 19:28:10.771579 11928 ts_tablet_manager.cc:1918] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:10.771948 11928 log.cc:1196] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/5f0828c3f81148008a7b6289053f2147
I20260812 19:28:10.772626 11928 ts_tablet_manager.cc:1939] T 5f0828c3f81148008a7b6289053f2147 P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:10.782356 11539 leader_election.cc:302] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:10.783175 11932 raft_consensus.cc:2781] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:10.783466 11932 raft_consensus.cc:482] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:10.783707 11932 raft_consensus.cc:3037] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:10.786299 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ef533fcc4a415396ac0784e0b73e3c" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
I20260812 19:28:10.786942 11797 raft_consensus.cc:2454] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 0.
I20260812 19:28:10.792049 11917 ts_tablet_manager.cc:1428] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.034s user 0.006s sys 0.000s
I20260812 19:28:10.801554 11932 raft_consensus.cc:504] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.804087 11932 leader_election.cc:288] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:10.806955 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ef533fcc4a415396ac0784e0b73e3c" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744"
I20260812 19:28:10.807535 11797 raft_consensus.cc:3037] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:10.813118 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ef533fcc4a415396ac0784e0b73e3c" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110"
I20260812 19:28:10.813707 11447 raft_consensus.cc:3037] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:10.831743 11797 raft_consensus.cc:2454] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 1.
I20260812 19:28:10.832954 11536 leader_election.cc:302] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 1d029ad126b9436aa9f4a1c9e1b6b18a; no voters:
I20260812 19:28:10.833856 11932 raft_consensus.cc:2781] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:10.834445 11932 raft_consensus.cc:686] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 LEADER]: Becoming Leader. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Running, Role: LEADER
I20260812 19:28:10.835577 11932 consensus_queue.cc:237] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.837390 11447 raft_consensus.cc:2454] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 1.
I20260812 19:28:10.847779 11917 tablet_bootstrap.cc:492] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:10.858572 11922 ts_tablet_manager.cc:1428] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.109s user 0.034s sys 0.034s
I20260812 19:28:10.882480 11917 tablet_bootstrap.cc:654] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.887718 11917 tablet_bootstrap.cc:492] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:10.888127 11917 ts_tablet_manager.cc:1397] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.041s user 0.011s sys 0.000s
I20260812 19:28:10.890803 11917 raft_consensus.cc:348] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.891439 11917 raft_consensus.cc:374] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.891685 11917 raft_consensus.cc:729] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.892344 11917 consensus_queue.cc:260] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.894402 11917 ts_tablet_manager.cc:1428] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260812 19:28:10.895222 11917 tablet_bootstrap.cc:492] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:10.906069 11917 tablet_bootstrap.cc:654] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:10.912436 11917 tablet_bootstrap.cc:492] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:10.912803 11917 ts_tablet_manager.cc:1397] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.000s
I20260812 19:28:10.914803 11917 raft_consensus.cc:348] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.915405 11917 raft_consensus.cc:374] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:10.915706 11917 raft_consensus.cc:729] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:10.917158 11917 consensus_queue.cc:260] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:10.919147 11917 ts_tablet_manager.cc:1428] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
W20260812 19:28:10.983031 11923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:28:10.983806 11923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:28:10.984429 11923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:28:11.028695 11923 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260812 19:28:11.029008 11923 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260812 19:28:11.029295 11923 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:28:11.029613 11923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:28:11.029918 11923 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:28:11.030187 11923 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:28:11.101438 11923 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36931
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:41467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.144.252
--webserver_port=46487
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
W20260812 19:28:11.103716 11373 connection.cc:535] server connection from 127.0.0.1:54630 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:11.103900 11869 connection.cc:535] client connection to 127.7.144.253:33833 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 19:28:11.104516 11923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
W20260812 19:28:11.106225 11869 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.144.253:33833)
W20260812 19:28:11.107528 11869 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.144.253:33833)
I20260812 19:28:11.107570 11923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:28:11.113881 11869 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.144.253:33833)
W20260812 19:28:11.117475 11869 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.144.253:33833)
W20260812 19:28:11.119824 11724 connection.cc:535] client connection to 127.7.144.253:33833 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:11.119966 11538 connection.cc:535] client connection to 127.7.144.253:33833 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:11.121078 11722 connection.cc:535] server connection from 127.0.0.1:38948 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:11.121690 11374 connection.cc:535] client connection to 127.7.144.253:33833 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:11.126598 12009 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 19:28:11.119816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.144.253:33833 (local address 127.0.0.1:36210)
0812 19:28:11.120521 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0812 19:28:11.120572 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0812 19:28:11.123643 (+ 3071us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 19:28:11.124035 (+ 392us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":111}
I20260812 19:28:11.157877 12011 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0ebc7fa78c6461fb1baa698aaf99ee4)
I20260812 19:28:11.158774 12011 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
W20260812 19:28:11.181471 12014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:11.197250 12011 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:11.225790 11950 raft_consensus.cc:482] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:11.226169 11932 raft_consensus.cc:482] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:11.226315 11950 raft_consensus.cc:504] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.226620 11932 raft_consensus.cc:504] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.228515 11932 leader_election.cc:288] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:11.229506 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:11.230183 11447 raft_consensus.cc:2454] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 0.
I20260812 19:28:11.231225 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
I20260812 19:28:11.231853 11797 raft_consensus.cc:2454] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 0.
I20260812 19:28:11.233942 11536 leader_election.cc:302] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 1d029ad126b9436aa9f4a1c9e1b6b18a; no voters:
W20260812 19:28:11.222992 11027 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:11.234814 11932 raft_consensus.cc:2781] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:11.235145 11932 raft_consensus.cc:482] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:11.235441 11932 raft_consensus.cc:3037] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:28:11.235596 11026 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467): Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:11.237473 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:11.237634 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:11.238195 12011 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:28:11.238224 11447 raft_consensus.cc:2454] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 0.
I20260812 19:28:11.239454 11725 leader_election.cc:302] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:11.242089 11950 leader_election.cc:288] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:11.242564 11950 raft_consensus.cc:2781] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:11.242837 11950 raft_consensus.cc:482] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:11.243127 11950 raft_consensus.cc:3037] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:11.245587 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" is_pre_election: true
I20260812 19:28:11.258376 11932 raft_consensus.cc:504] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.259454 11612 raft_consensus.cc:2379] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cc50828dde64ba6a456762a258fc744 in current term 1: Already voted for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in this term.
I20260812 19:28:11.261255 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110"
I20260812 19:28:11.261858 11447 raft_consensus.cc:3037] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:11.273221 11950 raft_consensus.cc:504] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.277892 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744"
I20260812 19:28:11.278892 11447 raft_consensus.cc:2454] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 1.
I20260812 19:28:11.280292 11932 leader_election.cc:288] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:11.280331 11539 leader_election.cc:302] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:11.282240 11932 raft_consensus.cc:2781] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:11.285883 11932 raft_consensus.cc:686] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 LEADER]: Becoming Leader. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Running, Role: LEADER
I20260812 19:28:11.286826 11932 consensus_queue.cc:237] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.289532 11797 raft_consensus.cc:2379] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in current term 1: Already voted for candidate 1cc50828dde64ba6a456762a258fc744 in this term.
I20260812 19:28:11.293412 11950 leader_election.cc:288] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:11.294695 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
W20260812 19:28:11.295290 11725 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.144.193:41739, user_credentials={real_user=slave}} blocked reactor thread for 55925.5us
I20260812 19:28:11.297075 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfadc0f92e8e4cdcbd893b44ca73a65d" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110"
I20260812 19:28:11.297907 11447 raft_consensus.cc:2379] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1cc50828dde64ba6a456762a258fc744 in current term 1: Already voted for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in this term.
I20260812 19:28:11.299034 11725 leader_election.cc:302] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744; no voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110
I20260812 19:28:11.300362 12022 raft_consensus.cc:2726] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260812 19:28:11.449123 11932 raft_consensus.cc:482] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:11.449584 11932 raft_consensus.cc:504] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.451191 11932 leader_election.cc:288] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:11.452184 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3df30578cb841a290855c251455f3d9" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:11.452900 11447 raft_consensus.cc:2454] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 0.
I20260812 19:28:11.454248 11539 leader_election.cc:302] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:11.453151 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3df30578cb841a290855c251455f3d9" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
I20260812 19:28:11.455178 11932 raft_consensus.cc:2781] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:11.455502 11932 raft_consensus.cc:482] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:11.455440 11797 raft_consensus.cc:2454] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 0.
I20260812 19:28:11.455782 11932 raft_consensus.cc:3037] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:11.464704 11932 raft_consensus.cc:504] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.466323 11932 leader_election.cc:288] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:11.467470 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3df30578cb841a290855c251455f3d9" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744"
I20260812 19:28:11.467593 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3df30578cb841a290855c251455f3d9" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110"
I20260812 19:28:11.468066 11797 raft_consensus.cc:3037] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:11.468120 11447 raft_consensus.cc:3037] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:11.474500 11447 raft_consensus.cc:2454] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 1.
I20260812 19:28:11.475543 11539 leader_election.cc:302] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:11.476348 11932 raft_consensus.cc:2781] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:11.476504 11797 raft_consensus.cc:2454] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 1.
I20260812 19:28:11.477154 11932 raft_consensus.cc:686] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 LEADER]: Becoming Leader. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Running, Role: LEADER
I20260812 19:28:11.479992 11932 consensus_queue.cc:237] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:11.646632 11932 consensus_queue.cc:1035] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:28:11.678577 11932 consensus_queue.cc:1035] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:28:11.981403 12037 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0ebc7fa78c6461fb1baa698aaf99ee4)
I20260812 19:28:11.982205 12037 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:11.985080 12037 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
W20260812 19:28:12.007120 11027 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:28:12.008798 11026 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467): Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:12.009445 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:12.010736 12037 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:28:12.242233 11996 consensus_queue.cc:1035] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:28:12.282785 12047 consensus_queue.cc:1035] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:28:12.288578 12048 consensus_queue.cc:1035] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:28:12.337320 12047 consensus_queue.cc:1035] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:28:12.530016 12010 debug-util.cc:398] Leaking SignalData structure 0x7b080001e820 after lost signal to thread 11923
W20260812 19:28:12.765081 12010 kernel_stack_watchdog.cc:198] Thread 11923 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 357ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260812 19:28:12.765198 11923 thread.cc:636] GCE (cloud detector) Time spent creating pthread: real 1.595s user 0.518s sys 0.925s
W20260812 19:28:11.183087 12013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:28:12.765630 11923 thread.cc:602] GCE (cloud detector) Time spent starting thread: real 1.596s user 0.518s sys 0.925s
I20260812 19:28:12.775130 12062 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0ebc7fa78c6461fb1baa698aaf99ee4)
I20260812 19:28:12.775792 12062 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:12.776178 11923 server_base.cc:1034] running on GCE node
W20260812 19:28:12.776115 12061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 19:28:12.777901 12062 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:12.778825 11923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:28:12.782305 11923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:28:12.783910 11923 hybrid_clock.cc:648] HybridClock initialized: now 1786562892783864 us; error 41 us; skew 500 ppm
W20260812 19:28:12.784521 11026 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467): Network error: Client connection negotiation failed: client connection to 127.7.144.252:41467: connect: Connection refused (error 111)
I20260812 19:28:12.785286 11923 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260812 19:28:12.785750 11027 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:12.786281 11027 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4, f056fc7d059f449da00729dc497e4da3
I20260812 19:28:12.787014 12062 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:28:12.793171 11923 webserver.cc:460] Webserver started at http://127.7.144.252:46487/ using document root <none> and password file <none>
I20260812 19:28:12.794080 11923 fs_manager.cc:359] Metadata directory not provided
I20260812 19:28:12.794310 11923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:28:12.803450 11923 fs_manager.cc:709] Time spent opening directory manager: real 0.006s user 0.006s sys 0.000s
I20260812 19:28:12.808997 12071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:12.810285 11923 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s
I20260812 19:28:12.810637 11923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
uuid: "f056fc7d059f449da00729dc497e4da3"
format_stamp: "Formatted at 2026-08-12 19:27:59 on dist-test-slave-0b58"
I20260812 19:28:12.813360 11923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:28:12.875053 11923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:28:12.876961 11923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:28:12.877470 11923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:28:12.958743 11923 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.252:41467
I20260812 19:28:12.959014 12128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.252:41467 every 8 connection(s)
I20260812 19:28:12.962349 11923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
I20260812 19:28:12.972123 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 11923
I20260812 19:28:12.973197 12129 sys_catalog.cc:263] Verifying existing consensus state
I20260812 19:28:12.979856 12129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Bootstrap starting.
I20260812 19:28:12.995998 12129 log.cc:824] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Log is configured to *not* fsync() on all Append() calls
I20260812 19:28:13.017925 12129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:28:13.018898 12129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Bootstrap complete.
I20260812 19:28:13.040582 12129 raft_consensus.cc:348] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:13.042974 12129 raft_consensus.cc:729] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 FOLLOWER]: Becoming Follower/Learner. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Initialized, Role: FOLLOWER
I20260812 19:28:13.043855 12129 consensus_queue.cc:260] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:13.047130 12133 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:13.047955 12133 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:13.047979 12129 sys_catalog.cc:564] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:28:13.090904 12147 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:13.091323 12147 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: success
I20260812 19:28:13.101517 12147 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: acquiring CA information for follower catalog manager: success
I20260812 19:28:13.108954 12147 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 19:28:13.136958 11923 master_runner.cc:186] Error getting master registration for 127.7.144.253:33833: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111),
I20260812 19:28:13.166668 11923 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:13.208914 11668 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:13.209381 11668 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
I20260812 19:28:13.216203 12093 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" instance_seqno: 1786562885991415) as {username='slave'} at 127.7.144.194:33843; Asking this server to re-register.
I20260812 19:28:13.217890 11668 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:13.221086 12093 ts_manager.cc:194] Registered new tserver with Master: 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:13.386617 11853 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:13.387215 11853 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
I20260812 19:28:13.390892 11497 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:13.391479 11497 heartbeater.cc:503] Master 127.7.144.252:41467 was elected leader, sending a full tablet report...
I20260812 19:28:13.392443 12092 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "1cc50828dde64ba6a456762a258fc744" instance_seqno: 1786562888060686) as {username='slave'} at 127.7.144.195:59065; Asking this server to re-register.
I20260812 19:28:13.393950 11853 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:13.395833 12092 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "7ae3a240f89541df8f79c381ff857110" instance_seqno: 1786562883762261) as {username='slave'} at 127.7.144.193:52617; Asking this server to re-register.
I20260812 19:28:13.397333 12093 ts_manager.cc:194] Registered new tserver with Master: 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:13.398614 11497 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:13.401692 12093 ts_manager.cc:194] Registered new tserver with Master: 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739)
I20260812 19:28:13.455919 12133 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:13.456462 12133 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:13.459234 12133 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
I20260812 19:28:13.460011 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:13.460826 11053 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f056fc7d059f449da00729dc497e4da3 in current term 6: Already voted for candidate c0ebc7fa78c6461fb1baa698aaf99ee4 in this term.
W20260812 19:28:13.460999 12075 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:28:13.465349 12075 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:13.465726 12075 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:13.466452 12133 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 5 FOLLOWER]: Advancing to term 6
I20260812 19:28:13.473507 12133 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 19:28:14.039813 12162 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:14.040392 12162 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:14.042100 12162 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
I20260812 19:28:14.042945 11053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f056fc7d059f449da00729dc497e4da3" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "2b825f98e3684b83869afc840fa6e68a" is_pre_election: true
I20260812 19:28:14.044049 11053 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f056fc7d059f449da00729dc497e4da3 for term 7 because replica has last-logged OpId of term: 6 index: 28, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260812 19:28:14.050550 12075 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:14.050941 12075 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:14.051585 12162 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 19:28:14.115059 12165 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c0ebc7fa78c6461fb1baa698aaf99ee4)
I20260812 19:28:14.115540 12165 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:14.126682 12165 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
W20260812 19:28:14.140450 11027 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111) [suppressed 6 similar messages]
I20260812 19:28:14.142546 12103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 28 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3" is_pre_election: true
I20260812 19:28:14.143424 12103 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2b825f98e3684b83869afc840fa6e68a in term 6.
I20260812 19:28:14.145509 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3; no voters:
I20260812 19:28:14.146461 12165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 19:28:14.146848 12165 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c0ebc7fa78c6461fb1baa698aaf99ee4)
W20260812 19:28:14.147059 11027 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:14.147286 12165 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:28:14.154700 12165 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:14.160602 12103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2b825f98e3684b83869afc840fa6e68a" candidate_term: 7 candidate_status { last_received { term: 6 index: 28 } } ignore_live_leader: false dest_uuid: "f056fc7d059f449da00729dc497e4da3"
I20260812 19:28:14.161183 12103 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 6 FOLLOWER]: Advancing to term 7
I20260812 19:28:14.168352 12103 raft_consensus.cc:2454] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2b825f98e3684b83869afc840fa6e68a in term 7.
W20260812 19:28:14.169714 11027 leader_election.cc:334] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:14.171972 11026 leader_election.cc:302] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2b825f98e3684b83869afc840fa6e68a, f056fc7d059f449da00729dc497e4da3; no voters: c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:14.174175 12165 leader_election.cc:288] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [CANDIDATE]: Term 7 election: Requested vote from peers c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833), f056fc7d059f449da00729dc497e4da3 (127.7.144.252:41467)
I20260812 19:28:14.174717 12165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 7 FOLLOWER]: Leader election won for term 7
I20260812 19:28:14.175196 12165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [term 7 LEADER]: Becoming Leader. State: Replica: 2b825f98e3684b83869afc840fa6e68a, State: Running, Role: LEADER
I20260812 19:28:14.176167 12165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 6.28, Last appended by leader: 28, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:14.192497 12171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b825f98e3684b83869afc840fa6e68a. Latest consensus state: current_term: 7 leader_uuid: "2b825f98e3684b83869afc840fa6e68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:14.193568 12171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:14.195525 12173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260812 19:28:14.203630 12173 catalog_manager.cc:669] Loaded metadata for table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]
I20260812 19:28:14.205075 12173 catalog_manager.cc:669] Loaded metadata for table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]
I20260812 19:28:14.206461 12173 catalog_manager.cc:669] Loaded metadata for table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]
I20260812 19:28:14.212807 12173 tablet_loader.cc:96] loaded metadata for tablet 53ef533fcc4a415396ac0784e0b73e3c (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb])
I20260812 19:28:14.215392 12173 tablet_loader.cc:96] loaded metadata for tablet bfadc0f92e8e4cdcbd893b44ca73a65d (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b])
I20260812 19:28:14.217288 12173 tablet_loader.cc:96] loaded metadata for tablet c3df30578cb841a290855c251455f3d9 (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71])
I20260812 19:28:14.218392 12173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260812 19:28:14.221851 12173 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:14.222070 12173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260812 19:28:14.229032 12173 catalog_manager.cc:1504] Loading token signing keys...
I20260812 19:28:14.232649 12173 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Loaded TSK: 0
I20260812 19:28:14.233788 12173 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260812 19:28:14.237527 12173 catalog_manager.cc:1527] Loading latest processed Hive Metastore notification log event ID...
I20260812 19:28:14.241014 12173 catalog_manager.cc:5717] Last processed Hive Metastore notification event ID: -1
I20260812 19:28:14.257450 12103 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Refusing update from remote peer 2b825f98e3684b83869afc840fa6e68a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 30. (index mismatch)
I20260812 19:28:14.258903 12165 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 6, Time since last communication: 0.000s
W20260812 19:28:14.259527 11027 consensus_peers.cc:487] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a -> Peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Couldn't send request to peer c0ebc7fa78c6461fb1baa698aaf99ee4. Status: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 19:28:14.302657 11043 master_service.cc:946] ReplaceTablet: received request to replace tablet 5f0828c3f81148008a7b6289053f2147 from {username='slave'} at 127.0.0.1:47542
I20260812 19:28:14.303695 11044 master_service.cc:946] ReplaceTablet: received request to replace tablet bfadc0f92e8e4cdcbd893b44ca73a65d from {username='slave'} at 127.0.0.1:47542
I20260812 19:28:14.329207 12182 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "2b825f98e3684b83869afc840fa6e68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:14.329545 12162 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b825f98e3684b83869afc840fa6e68a. Latest consensus state: current_term: 7 leader_uuid: "2b825f98e3684b83869afc840fa6e68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:14.330160 12182 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:14.330420 12162 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:14.333674 12171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "2b825f98e3684b83869afc840fa6e68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:14.334462 12171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a [sys.catalog]: This master's current role is: LEADER
I20260812 19:28:14.336532 12186 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "2b825f98e3684b83869afc840fa6e68a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:14.337481 12186 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:14.305008 11040 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47542:
table { table_name: "default.Table_279342716cbf40c182ee3606ef8f6012" } modify_external_catalogs: true
I20260812 19:28:14.300712 11041 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47542:
name: "default.Table_78fcf6ed4cc84fd08834fb2962652e3b"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:14.300956 11042 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47542:
name: "default.Table_305f7ed346be4cfc8f4291849bf77448"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:14.356382 11040 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47542:
table { table_name: "default.Table_279342716cbf40c182ee3606ef8f6012" } modify_external_catalogs: true
I20260812 19:28:14.306131 11039 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47542:
name: "default.Table_05da0fc81466451091ddbe2cb3550364"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:14.307192 11038 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47542:
name: "default.Table_5ae6dd5fee2147feaddc748713fd148c"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260812 19:28:14.308133 11037 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47542:
table { table_name: "default.Table_c61586dbd5154f9a80c6e66da55197d9" } new_table_name: "default.Table_7a3fe4a2893a48cea8ca3e70e6bc3298" modify_external_catalogs: true
I20260812 19:28:14.309072 11036 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:47542:
table { table_name: "default.Table_d39ddbbb97d342f980386549e6e3fa6c" } new_table_name: "default.Table_14f1ef71159241808156342751f747e6" modify_external_catalogs: true
I20260812 19:28:14.373852 11044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Sending DeleteTablet for 3 replicas of tablet bfadc0f92e8e4cdcbd893b44ca73a65d
F20260812 19:28:14.380139 11338 hms_notification_log_listener.cc:264] Received out-of-order notification log event (last processed event ID: 1): 1 CREATE_TABLE default.table_790d8e4400e84a078b13df4b7b4c6ed5
*** Check failure stack trace: ***
I20260812 19:28:14.384002 11044 catalog_manager.cc:6565] ReplaceTablet: tablet bfadc0f92e8e4cdcbd893b44ca73a65d deleted and replaced by tablet a4eb34d983164940814ea84216339ad9
I20260812 19:28:14.395550 12177 mvcc.cc:205] Tried to move back new op lower bound from 7317761614861447168 to 7317761591884120064. Current Snapshot: MvccSnapshot[applied={T|T < 7317761614861447168}]
I20260812 19:28:14.417891 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet bfadc0f92e8e4cdcbd893b44ca73a65d with delete_type TABLET_DATA_DELETED (replaced by tablet a4eb34d983164940814ea84216339ad9) from {username='slave'} at 127.0.0.1:34722
I20260812 19:28:14.426913 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet bfadc0f92e8e4cdcbd893b44ca73a65d with delete_type TABLET_DATA_DELETED (replaced by tablet a4eb34d983164940814ea84216339ad9) from {username='slave'} at 127.0.0.1:42380
@ 0x7fb3a49ca9a0 google::LogMessage::Flush() at ??:0
I20260812 19:28:14.444952 11590 tablet_service.cc:1467] Processing CreateTablet for tablet a4eb34d983164940814ea84216339ad9 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.446969 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4eb34d983164940814ea84216339ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.450009 11423 tablet_service.cc:1467] Processing CreateTablet for tablet a4eb34d983164940814ea84216339ad9 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.451496 11423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4eb34d983164940814ea84216339ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.463973 12196 tablet_replica.cc:330] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:14.464885 12196 raft_consensus.cc:2229] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.465523 12196 raft_consensus.cc:2258] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.467815 12196 ts_tablet_manager.cc:1905] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fb3a49ca70f google::LogMessage::~LogMessage() at ??:0
I20260812 19:28:14.498202 12193 tablet_replica.cc:330] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:14.499054 12193 raft_consensus.cc:2229] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:28:14.508498 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet bfadc0f92e8e4cdcbd893b44ca73a65d with delete_type TABLET_DATA_DELETED (replaced by tablet a4eb34d983164940814ea84216339ad9) from {username='slave'} at 127.0.0.1:49166
I20260812 19:28:14.511445 11775 tablet_service.cc:1467] Processing CreateTablet for tablet a4eb34d983164940814ea84216339ad9 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.512626 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a4eb34d983164940814ea84216339ad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.512970 12193 raft_consensus.cc:2258] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.515705 12193 ts_tablet_manager.cc:1905] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.537179 12203 tablet_bootstrap.cc:492] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:14.542174 12201 tablet_bootstrap.cc:492] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:14.543975 12202 tablet_replica.cc:330] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:14.544817 12202 raft_consensus.cc:2229] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.545325 12202 raft_consensus.cc:2258] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.547034 12201 tablet_bootstrap.cc:654] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:14.547219 12202 ts_tablet_manager.cc:1905] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fb3afa59aea kudu::master::HmsNotificationLogListenerTask::Poll() at ??:0
I20260812 19:28:14.561355 11044 master_service.cc:946] ReplaceTablet: received request to replace tablet a4eb34d983164940814ea84216339ad9 from {username='slave'} at 127.0.0.1:47542
I20260812 19:28:14.566406 12203 tablet_bootstrap.cc:654] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:14.575728 12196 ts_tablet_manager.cc:1918] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.576340 12196 log.cc:1196] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/bfadc0f92e8e4cdcbd893b44ca73a65d
I20260812 19:28:14.577526 12196 ts_tablet_manager.cc:1939] T bfadc0f92e8e4cdcbd893b44ca73a65d P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:14.585656 11044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Sending DeleteTablet for 3 replicas of tablet a4eb34d983164940814ea84216339ad9
I20260812 19:28:14.587019 11044 catalog_manager.cc:6565] ReplaceTablet: tablet a4eb34d983164940814ea84216339ad9 deleted and replaced by tablet ce082dbdf29448099415b571866db633
I20260812 19:28:14.589722 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet a4eb34d983164940814ea84216339ad9 with delete_type TABLET_DATA_DELETED (replaced by tablet ce082dbdf29448099415b571866db633) from {username='slave'} at 127.0.0.1:49166
I20260812 19:28:14.590035 11423 tablet_service.cc:1514] Processing DeleteTablet for tablet a4eb34d983164940814ea84216339ad9 with delete_type TABLET_DATA_DELETED (replaced by tablet ce082dbdf29448099415b571866db633) from {username='slave'} at 127.0.0.1:42380
I20260812 19:28:14.590018 11590 tablet_service.cc:1514] Processing DeleteTablet for tablet a4eb34d983164940814ea84216339ad9 with delete_type TABLET_DATA_DELETED (replaced by tablet ce082dbdf29448099415b571866db633) from {username='slave'} at 127.0.0.1:34722
I20260812 19:28:14.592556 12207 tablet_bootstrap.cc:492] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:14.597772 12193 ts_tablet_manager.cc:1918] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.593803 11043 master_service.cc:946] ReplaceTablet: received request to replace tablet 53ef533fcc4a415396ac0784e0b73e3c from {username='slave'} at 127.0.0.1:47542
I20260812 19:28:14.599074 11028 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet bfadc0f92e8e4cdcbd893b44ca73a65d (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
W20260812 19:28:14.601090 11028 catalog_manager.cc:4821] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): delete failed for tablet a4eb34d983164940814ea84216339ad9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4eb34d983164940814ea84216339ad9 already in progress: creating tablet
I20260812 19:28:14.601995 12193 log.cc:1196] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/bfadc0f92e8e4cdcbd893b44ca73a65d
I20260812 19:28:14.602993 12193 ts_tablet_manager.cc:1939] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:14.605960 11027 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet bfadc0f92e8e4cdcbd893b44ca73a65d (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
I20260812 19:28:14.608074 12201 tablet_bootstrap.cc:492] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:14.608556 12201 ts_tablet_manager.cc:1397] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.067s user 0.010s sys 0.012s
I20260812 19:28:14.611119 12201 raft_consensus.cc:348] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.612125 12201 raft_consensus.cc:374] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:14.612525 12201 raft_consensus.cc:729] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:14.613266 12207 tablet_bootstrap.cc:654] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:14.613204 12201 consensus_queue.cc:260] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
W20260812 19:28:14.615902 11027 catalog_manager.cc:4821] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): delete failed for tablet a4eb34d983164940814ea84216339ad9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4eb34d983164940814ea84216339ad9 already in progress: creating tablet
I20260812 19:28:14.623224 12201 ts_tablet_manager.cc:1428] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.014s user 0.006s sys 0.004s
I20260812 19:28:14.625958 11500 heartbeater.cc:503] Master 127.7.144.254:36253 was elected leader, sending a full tablet report...
I20260812 19:28:14.631625 11590 tablet_service.cc:1467] Processing CreateTablet for tablet ce082dbdf29448099415b571866db633 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.631693 11423 tablet_service.cc:1467] Processing CreateTablet for tablet ce082dbdf29448099415b571866db633 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.632781 11423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce082dbdf29448099415b571866db633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.632802 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce082dbdf29448099415b571866db633. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.634637 12202 ts_tablet_manager.cc:1918] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.635041 12202 log.cc:1196] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/bfadc0f92e8e4cdcbd893b44ca73a65d
I20260812 19:28:14.635821 12202 ts_tablet_manager.cc:1939] T bfadc0f92e8e4cdcbd893b44ca73a65d P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:14.644203 11775 tablet_service.cc:1467] Processing CreateTablet for tablet ce082dbdf29448099415b571866db633 (DEFAULT_TABLE table=default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.645953 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce082dbdf29448099415b571866db633. 1 dirs total, 0 dirs full, 0 dirs failed
@ 0x7fb3afa5933c kudu::master::HmsNotificationLogListenerTask::RunLoop() at ??:0
I20260812 19:28:14.655232 11026 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet bfadc0f92e8e4cdcbd893b44ca73a65d (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
W20260812 19:28:14.656075 11026 catalog_manager.cc:4821] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): delete failed for tablet a4eb34d983164940814ea84216339ad9 because tablet deleting was already in progress. No further retry: Already present: State transition of tablet a4eb34d983164940814ea84216339ad9 already in progress: creating tablet
I20260812 19:28:14.668159 11043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Sending DeleteTablet for 3 replicas of tablet 53ef533fcc4a415396ac0784e0b73e3c
I20260812 19:28:14.671218 11044 catalog_manager.cc:5495] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194). New cstate: current_term: 1 leader_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } }
I20260812 19:28:14.674250 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ef533fcc4a415396ac0784e0b73e3c with delete_type TABLET_DATA_DELETED (replaced by tablet ed49cf31c9d8459da5bea1d3a07b5fa0) from {username='slave'} at 127.0.0.1:42380
I20260812 19:28:14.675009 12196 tablet_replica.cc:330] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:14.675714 12196 raft_consensus.cc:2229] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.676173 12196 raft_consensus.cc:2258] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus is shut down!
@ 0x7fb3afa5cfd2 kudu::master::HmsNotificationLogListenerTask::Init()::$_0::operator()() at ??:0
I20260812 19:28:14.678112 12196 ts_tablet_manager.cc:1905] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.681514 12203 tablet_bootstrap.cc:492] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:14.681962 12203 ts_tablet_manager.cc:1397] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.145s user 0.019s sys 0.008s
I20260812 19:28:14.682950 11043 catalog_manager.cc:6565] ReplaceTablet: tablet 53ef533fcc4a415396ac0784e0b73e3c deleted and replaced by tablet ed49cf31c9d8459da5bea1d3a07b5fa0
I20260812 19:28:14.683545 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ef533fcc4a415396ac0784e0b73e3c with delete_type TABLET_DATA_DELETED (replaced by tablet ed49cf31c9d8459da5bea1d3a07b5fa0) from {username='slave'} at 127.0.0.1:34722
I20260812 19:28:14.684290 12193 tablet_replica.cc:330] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:14.684489 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ef533fcc4a415396ac0784e0b73e3c with delete_type TABLET_DATA_DELETED (replaced by tablet ed49cf31c9d8459da5bea1d3a07b5fa0) from {username='slave'} at 127.0.0.1:49166
I20260812 19:28:14.685226 12202 tablet_replica.cc:330] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:14.685911 12202 raft_consensus.cc:2229] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.686465 12202 raft_consensus.cc:2258] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.688346 12202 ts_tablet_manager.cc:1905] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.709072 12207 tablet_bootstrap.cc:492] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:14.709524 12207 ts_tablet_manager.cc:1397] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.000s
I20260812 19:28:14.712530 12196 ts_tablet_manager.cc:1918] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.712972 12196 log.cc:1196] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/53ef533fcc4a415396ac0784e0b73e3c
I20260812 19:28:14.713805 12196 ts_tablet_manager.cc:1939] T 53ef533fcc4a415396ac0784e0b73e3c P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:14.720326 12193 raft_consensus.cc:2229] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:28:14.721917 12193 raft_consensus.cc:2258] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.723984 12193 ts_tablet_manager.cc:1905] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.728940 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet a4eb34d983164940814ea84216339ad9 with delete_type TABLET_DATA_DELETED (replaced by tablet ce082dbdf29448099415b571866db633) from {username='slave'} at 127.0.0.1:42380
I20260812 19:28:14.731689 12202 ts_tablet_manager.cc:1918] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.732064 12202 log.cc:1196] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/53ef533fcc4a415396ac0784e0b73e3c
@ 0x7fb3afa5cf8a _ZNSt3__18__invokeIRZN4kudu6master30HmsNotificationLogListenerTask4InitEvE3$_0JEEEDTclclsr3std3__1E7forwardIT_Efp_Espclsr3std3__1E7forwardIT0_Efp0_EEEOS6_DpOS7_ at ??:0
I20260812 19:28:14.719676 12203 raft_consensus.cc:348] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.738027 12196 tablet_replica.cc:330] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:14.738140 12203 raft_consensus.cc:374] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:14.738437 12203 raft_consensus.cc:729] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:14.738776 12196 raft_consensus.cc:2229] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.739228 12196 raft_consensus.cc:2258] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.740126 12203 consensus_queue.cc:260] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.741585 12196 ts_tablet_manager.cc:1905] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.742115 12201 tablet_bootstrap.cc:492] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:14.747874 12201 tablet_bootstrap.cc:654] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:14.751943 11670 heartbeater.cc:503] Master 127.7.144.254:36253 was elected leader, sending a full tablet report...
I20260812 19:28:14.769513 11028 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet 53ef533fcc4a415396ac0784e0b73e3c (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:14.773990 12203 ts_tablet_manager.cc:1428] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.092s user 0.004s sys 0.004s
I20260812 19:28:14.774864 12203 tablet_bootstrap.cc:492] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:14.732947 12207 raft_consensus.cc:348] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.776551 12207 raft_consensus.cc:374] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:14.776873 12207 raft_consensus.cc:729] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:14.777657 12207 consensus_queue.cc:260] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.779673 12202 ts_tablet_manager.cc:1939] T 53ef533fcc4a415396ac0784e0b73e3c P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:14.782588 11026 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet 53ef533fcc4a415396ac0784e0b73e3c (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
@ 0x7fb3afa5cf1a std::__1::__invoke_void_return_wrapper<>::__call<>() at ??:0
I20260812 19:28:14.800613 12196 ts_tablet_manager.cc:1918] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:14.801038 12196 log.cc:1196] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/a4eb34d983164940814ea84216339ad9
I20260812 19:28:14.801779 12196 ts_tablet_manager.cc:1939] T a4eb34d983164940814ea84216339ad9 P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
I20260812 19:28:14.806968 11043 master_service.cc:946] ReplaceTablet: received request to replace tablet c3df30578cb841a290855c251455f3d9 from {username='slave'} at 127.0.0.1:47542
I20260812 19:28:14.807240 11590 tablet_service.cc:1467] Processing CreateTablet for tablet ed49cf31c9d8459da5bea1d3a07b5fa0 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.808404 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed49cf31c9d8459da5bea1d3a07b5fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.810392 12201 tablet_bootstrap.cc:492] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:14.810667 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet a4eb34d983164940814ea84216339ad9 with delete_type TABLET_DATA_DELETED (replaced by tablet ce082dbdf29448099415b571866db633) from {username='slave'} at 127.0.0.1:34722
I20260812 19:28:14.810825 12201 ts_tablet_manager.cc:1397] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.069s user 0.009s sys 0.000s
I20260812 19:28:14.812029 11775 tablet_service.cc:1467] Processing CreateTablet for tablet ed49cf31c9d8459da5bea1d3a07b5fa0 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.813205 11775 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed49cf31c9d8459da5bea1d3a07b5fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.816411 11423 tablet_service.cc:1467] Processing CreateTablet for tablet ed49cf31c9d8459da5bea1d3a07b5fa0 (DEFAULT_TABLE table=default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.818969 11858 heartbeater.cc:503] Master 127.7.144.254:36253 was elected leader, sending a full tablet report...
I20260812 19:28:14.820791 11028 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet a4eb34d983164940814ea84216339ad9 (table default.table_279342716cbf40c182ee3606ef8f6012 [id=b1e50453323d4d02aeded5f539bcec7b]) successfully deleted
I20260812 19:28:14.817493 11423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ed49cf31c9d8459da5bea1d3a07b5fa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.831864 12207 ts_tablet_manager.cc:1428] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.122s user 0.005s sys 0.004s
I20260812 19:28:14.840320 11043 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2b825f98e3684b83869afc840fa6e68a: Sending DeleteTablet for 3 replicas of tablet c3df30578cb841a290855c251455f3d9
I20260812 19:28:14.841912 11043 catalog_manager.cc:6565] ReplaceTablet: tablet c3df30578cb841a290855c251455f3d9 deleted and replaced by tablet 1293c85b89b140c7a9c1c331390ba8f0
I20260812 19:28:14.843986 12207 tablet_bootstrap.cc:492] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:14.844692 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet c3df30578cb841a290855c251455f3d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 1293c85b89b140c7a9c1c331390ba8f0) from {username='slave'} at 127.0.0.1:42380
I20260812 19:28:14.846273 11774 tablet_service.cc:1514] Processing DeleteTablet for tablet c3df30578cb841a290855c251455f3d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 1293c85b89b140c7a9c1c331390ba8f0) from {username='slave'} at 127.0.0.1:49166
I20260812 19:28:14.854022 12196 tablet_replica.cc:330] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: stopping tablet replica
I20260812 19:28:14.854840 12196 raft_consensus.cc:2229] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.855387 12196 raft_consensus.cc:2258] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.858294 11589 tablet_service.cc:1514] Processing DeleteTablet for tablet c3df30578cb841a290855c251455f3d9 with delete_type TABLET_DATA_DELETED (replaced by tablet 1293c85b89b140c7a9c1c331390ba8f0) from {username='slave'} at 127.0.0.1:34722
I20260812 19:28:14.858574 12196 ts_tablet_manager.cc:1905] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.852810 12201 raft_consensus.cc:348] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.862273 12201 raft_consensus.cc:374] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:14.862562 12201 raft_consensus.cc:729] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:14.863531 12202 tablet_replica.cc:330] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
I20260812 19:28:14.865271 12201 consensus_queue.cc:260] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.867300 12201 ts_tablet_manager.cc:1428] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.056s user 0.004s sys 0.003s
I20260812 19:28:14.868580 12202 raft_consensus.cc:2229] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.873368 12203 tablet_bootstrap.cc:654] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:14.878605 12196 ts_tablet_manager.cc:1918] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.878997 12196 log.cc:1196] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-0/wal/wals/c3df30578cb841a290855c251455f3d9
I20260812 19:28:14.879722 12196 ts_tablet_manager.cc:1939] T c3df30578cb841a290855c251455f3d9 P 7ae3a240f89541df8f79c381ff857110: Deleting consensus metadata
@ 0x7fb3afa5cee2 std::__1::__function::__alloc_func<>::operator()() at ??:0
I20260812 19:28:14.884320 12202 raft_consensus.cc:2258] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:14.886354 12202 ts_tablet_manager.cc:1905] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.894523 12170 raft_consensus.cc:482] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:14.894999 12170 raft_consensus.cc:504] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.903658 12170 leader_election.cc:288] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:14.903913 11034 master_service.cc:946] ReplaceTablet: received request to replace tablet c3df30578cb841a290855c251455f3d9 from {username='slave'} at 127.0.0.1:47542
I20260812 19:28:14.905454 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4eb34d983164940814ea84216339ad9" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
I20260812 19:28:14.906147 11797 raft_consensus.cc:2454] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d029ad126b9436aa9f4a1c9e1b6b18a in term 0.
I20260812 19:28:14.906512 11590 tablet_service.cc:1467] Processing CreateTablet for tablet 1293c85b89b140c7a9c1c331390ba8f0 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.907667 11590 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1293c85b89b140c7a9c1c331390ba8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.907588 11774 tablet_service.cc:1467] Processing CreateTablet for tablet 1293c85b89b140c7a9c1c331390ba8f0 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.908236 11536 leader_election.cc:302] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 1d029ad126b9436aa9f4a1c9e1b6b18a; no voters:
I20260812 19:28:14.908701 11774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1293c85b89b140c7a9c1c331390ba8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.909127 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 1293c85b89b140c7a9c1c331390ba8f0 (DEFAULT_TABLE table=default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 19:28:14.911514 12202 ts_tablet_manager.cc:1918] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.911862 12202 log.cc:1196] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/c3df30578cb841a290855c251455f3d9
W20260812 19:28:14.912416 11539 leader_election.cc:341] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): Not found: Tablet not found: a4eb34d983164940814ea84216339ad9
I20260812 19:28:14.912649 12202 ts_tablet_manager.cc:1939] T c3df30578cb841a290855c251455f3d9 P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:14.915231 12170 raft_consensus.cc:2781] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:14.915571 12170 raft_consensus.cc:482] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:14.915872 12170 raft_consensus.cc:3037] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:14.916247 11026 catalog_manager.cc:4841] TS 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): tablet c3df30578cb841a290855c251455f3d9 (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]) successfully deleted
I20260812 19:28:14.916715 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1293c85b89b140c7a9c1c331390ba8f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 19:28:14.922643 12170 raft_consensus.cc:504] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.923846 11775 tablet_service.cc:1514] Processing DeleteTablet for tablet a4eb34d983164940814ea84216339ad9 with delete_type TABLET_DATA_DELETED (replaced by tablet ce082dbdf29448099415b571866db633) from {username='slave'} at 127.0.0.1:49166
I20260812 19:28:14.926105 11028 catalog_manager.cc:4841] TS 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): tablet c3df30578cb841a290855c251455f3d9 (table default.table_c61586dbd5154f9a80c6e66da55197d9 [id=17bbb9453e9f4b22ba0d33f5174eec71]) successfully deleted
I20260812 19:28:14.929721 12202 tablet_replica.cc:330] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: stopping tablet replica
@ 0x7fb3afa5c1de std::__1::__function::__func<>::operator()() at ??:0
I20260812 19:28:14.930469 12202 raft_consensus.cc:2229] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.930670 12201 tablet_bootstrap.cc:492] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:14.930974 12202 raft_consensus.cc:2258] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Raft consensus is shut down!
@ 0x580785 std::__1::__function::__value_func<>::operator()() at ??:?
I20260812 19:28:14.932348 12207 tablet_bootstrap.cc:654] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:14.936491 12202 ts_tablet_manager.cc:1905] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:14.884136 12193 ts_tablet_manager.cc:1918] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:14.943971 12193 log.cc:1196] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/53ef533fcc4a415396ac0784e0b73e3c
@ 0x5805ba std::__1::function<>::operator()() at ??:?
I20260812 19:28:14.944792 12193 ts_tablet_manager.cc:1939] T 53ef533fcc4a415396ac0784e0b73e3c P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:14.948544 12170 leader_election.cc:288] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:14.950373 12193 tablet_replica.cc:330] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:14.950778 11027 catalog_manager.cc:4841] TS 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189): tablet 53ef533fcc4a415396ac0784e0b73e3c (table default.table_d39ddbbb97d342f980386549e6e3fa6c [id=b0eeb9d318d642f38479d6946246ecdb]) successfully deleted
I20260812 19:28:14.950820 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a4eb34d983164940814ea84216339ad9" candidate_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744"
I20260812 19:28:14.951072 12193 raft_consensus.cc:2229] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 19:28:14.951509 12193 raft_consensus.cc:2258] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260812 19:28:14.952159 11539 leader_election.cc:341] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739): Not found: Tablet not found: a4eb34d983164940814ea84216339ad9
W20260812 19:28:14.953306 11536 leader_election.cc:341] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): Illegal state: Tablet not RUNNING: STOPPED
I20260812 19:28:14.953684 11536 leader_election.cc:302] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a; no voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110
W20260812 19:28:14.954267 11536 raft_consensus.cc:2670] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260812 19:28:14.954290 12203 tablet_bootstrap.cc:492] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:14.956000 12203 ts_tablet_manager.cc:1397] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.181s user 0.007s sys 0.004s
I20260812 19:28:14.958369 12203 raft_consensus.cc:348] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.959031 12203 raft_consensus.cc:374] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:14.959278 12203 raft_consensus.cc:729] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:14.963563 12203 consensus_queue.cc:260] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:14.965811 12207 tablet_bootstrap.cc:492] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:14.966277 12207 ts_tablet_manager.cc:1397] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.122s user 0.006s sys 0.004s
I20260812 19:28:14.968086 12203 ts_tablet_manager.cc:1428] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
@ 0x7fb3a6b7bdc7 kudu::Thread::SuperviseThread() at ??:0
@ 0x4230f0 __tsan_thread_start_func at ??:?
W20260812 19:28:14.977411 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000df140 after lost signal to thread 11345
I20260812 19:28:14.983385 12201 tablet_bootstrap.cc:654] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:14.985852 12203 tablet_bootstrap.cc:492] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:14.995484 12203 tablet_bootstrap.cc:654] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:15.000777 12193 ts_tablet_manager.cc:1905] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
@ 0x7fb3a81e96db start_thread at ??:0
I20260812 19:28:15.003288 12207 raft_consensus.cc:348] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.004115 12207 raft_consensus.cc:374] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:15.004433 12207 raft_consensus.cc:729] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:15.013506 12203 tablet_bootstrap.cc:492] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:15.013959 12203 ts_tablet_manager.cc:1397] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.028s user 0.010s sys 0.003s
I20260812 19:28:15.016593 12207 consensus_queue.cc:260] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.018774 12207 ts_tablet_manager.cc:1428] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.052s user 0.006s sys 0.000s
I20260812 19:28:15.019682 12207 tablet_bootstrap.cc:492] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:15.016961 12203 raft_consensus.cc:348] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.044788 12203 raft_consensus.cc:374] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:15.045212 12203 raft_consensus.cc:729] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:15.046851 12203 consensus_queue.cc:260] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.050628 12201 tablet_bootstrap.cc:492] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:15.051061 12201 ts_tablet_manager.cc:1397] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.121s user 0.002s sys 0.010s
I20260812 19:28:15.053593 12201 raft_consensus.cc:348] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
@ 0x7fb3a366f61f clone at ??:0
I20260812 19:28:15.054299 12201 raft_consensus.cc:374] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:15.061322 12201 raft_consensus.cc:729] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:15.062134 12203 ts_tablet_manager.cc:1428] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.048s user 0.008s sys 0.000s
I20260812 19:28:15.062101 12201 consensus_queue.cc:260] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.065070 12202 ts_tablet_manager.cc:1918] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:15.065469 12202 log.cc:1196] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-2/wal/wals/a4eb34d983164940814ea84216339ad9
I20260812 19:28:15.076922 12203 tablet_bootstrap.cc:492] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Bootstrap starting.
I20260812 19:28:15.092612 12207 tablet_bootstrap.cc:654] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:15.094141 12201 ts_tablet_manager.cc:1428] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.043s user 0.005s sys 0.002s
I20260812 19:28:15.092658 12202 ts_tablet_manager.cc:1939] T a4eb34d983164940814ea84216339ad9 P 1cc50828dde64ba6a456762a258fc744: Deleting consensus metadata
I20260812 19:28:15.104970 12201 tablet_bootstrap.cc:492] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110: Bootstrap starting.
I20260812 19:28:15.115178 12193 ts_tablet_manager.cc:1918] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 0.0
I20260812 19:28:15.127627 12193 log.cc:1196] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/a4eb34d983164940814ea84216339ad9
I20260812 19:28:15.119016 12203 tablet_bootstrap.cc:654] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:15.130128 12207 tablet_bootstrap.cc:492] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:15.130638 12207 ts_tablet_manager.cc:1397] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.111s user 0.009s sys 0.002s
I20260812 19:28:15.133548 12207 raft_consensus.cc:348] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.139421 12201 tablet_bootstrap.cc:654] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:15.136971 12193 ts_tablet_manager.cc:1939] T a4eb34d983164940814ea84216339ad9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:15.142558 12193 tablet_replica.cc:330] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: stopping tablet replica
I20260812 19:28:15.148391 12207 raft_consensus.cc:374] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:15.148797 12207 raft_consensus.cc:729] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:15.152577 12207 consensus_queue.cc:260] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.153899 12193 raft_consensus.cc:2229] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 LEADER]: Raft consensus shutting down.
I20260812 19:28:15.154836 12193 raft_consensus.cc:2258] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 19:28:15.169945 12193 ts_tablet_manager.cc:1905] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260812 19:28:15.171115 12207 ts_tablet_manager.cc:1428] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.040s user 0.006s sys 0.000s
I20260812 19:28:15.177675 12207 tablet_bootstrap.cc:492] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744: Bootstrap starting.
I20260812 19:28:15.162246 12203 tablet_bootstrap.cc:492] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: No bootstrap required, opened a new log
I20260812 19:28:15.180650 12203 ts_tablet_manager.cc:1397] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent bootstrapping tablet: real 0.104s user 0.005s sys 0.006s
I20260812 19:28:15.183624 12203 raft_consensus.cc:348] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.186678 12203 raft_consensus.cc:374] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:15.190483 12203 raft_consensus.cc:729] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d029ad126b9436aa9f4a1c9e1b6b18a, State: Initialized, Role: FOLLOWER
I20260812 19:28:15.192816 12201 tablet_bootstrap.cc:492] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110: No bootstrap required, opened a new log
I20260812 19:28:15.193316 12201 ts_tablet_manager.cc:1397] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110: Time spent bootstrapping tablet: real 0.089s user 0.009s sys 0.002s
I20260812 19:28:15.195184 12218 raft_consensus.cc:482] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:15.195622 12218 raft_consensus.cc:504] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.197595 12218 leader_election.cc:288] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:15.198597 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce082dbdf29448099415b571866db633" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:15.199317 11447 raft_consensus.cc:2454] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 0.
I20260812 19:28:15.199401 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce082dbdf29448099415b571866db633" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" is_pre_election: true
I20260812 19:28:15.200124 11612 raft_consensus.cc:2454] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 0.
I20260812 19:28:15.200517 11725 leader_election.cc:302] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:15.201905 12218 raft_consensus.cc:2781] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:15.202283 12218 raft_consensus.cc:482] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:15.202636 12218 raft_consensus.cc:3037] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.209386 12218 raft_consensus.cc:504] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.212563 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce082dbdf29448099415b571866db633" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
I20260812 19:28:15.212756 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce082dbdf29448099415b571866db633" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110"
I20260812 19:28:15.213140 11612 raft_consensus.cc:3037] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.213284 11447 raft_consensus.cc:3037] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.219846 11447 raft_consensus.cc:2454] T ce082dbdf29448099415b571866db633 P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 1.
I20260812 19:28:15.219846 11612 raft_consensus.cc:2454] T ce082dbdf29448099415b571866db633 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 1.
I20260812 19:28:15.221212 11725 leader_election.cc:302] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:15.223264 12236 raft_consensus.cc:2781] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:15.224383 12218 leader_election.cc:288] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:15.225643 12203 consensus_queue.cc:260] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.235695 12203 ts_tablet_manager.cc:1428] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Time spent starting tablet: real 0.055s user 0.001s sys 0.005s
I20260812 19:28:15.244704 12236 raft_consensus.cc:686] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [term 1 LEADER]: Becoming Leader. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Running, Role: LEADER
I20260812 19:28:15.244784 12201 raft_consensus.cc:348] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.245561 12201 raft_consensus.cc:374] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:15.245975 12201 raft_consensus.cc:729] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Initialized, Role: FOLLOWER
I20260812 19:28:15.245604 12236 consensus_queue.cc:237] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.246768 12201 consensus_queue.cc:260] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.282438 12201 ts_tablet_manager.cc:1428] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110: Time spent starting tablet: real 0.089s user 0.005s sys 0.000s
I20260812 19:28:15.286425 12207 tablet_bootstrap.cc:654] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744: Neither blocks nor log segments found. Creating new log.
I20260812 19:28:15.287240 12210 raft_consensus.cc:482] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:15.287701 12210 raft_consensus.cc:504] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.289738 12210 leader_election.cc:288] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:15.291213 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1293c85b89b140c7a9c1c331390ba8f0" candidate_uuid: "7ae3a240f89541df8f79c381ff857110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744" is_pre_election: true
I20260812 19:28:15.291829 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1293c85b89b140c7a9c1c331390ba8f0" candidate_uuid: "7ae3a240f89541df8f79c381ff857110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" is_pre_election: true
I20260812 19:28:15.292511 11612 raft_consensus.cc:2454] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ae3a240f89541df8f79c381ff857110 in term 0.
W20260812 19:28:15.292734 11373 leader_election.cc:341] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:28:15.293664 11374 leader_election.cc:302] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110; no voters: 1cc50828dde64ba6a456762a258fc744
I20260812 19:28:15.294675 12210 raft_consensus.cc:2781] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:15.294996 12210 raft_consensus.cc:482] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:15.295300 12210 raft_consensus.cc:3037] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.297123 12236 raft_consensus.cc:482] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:15.297564 12236 raft_consensus.cc:504] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.299393 12236 leader_election.cc:288] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:15.301054 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed49cf31c9d8459da5bea1d3a07b5fa0" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:15.301707 11447 raft_consensus.cc:2454] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 0.
I20260812 19:28:15.302687 11610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed49cf31c9d8459da5bea1d3a07b5fa0" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" is_pre_election: true
I20260812 19:28:15.302850 11725 leader_election.cc:302] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:15.303344 11610 raft_consensus.cc:2454] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 0.
I20260812 19:28:15.303669 12236 raft_consensus.cc:2781] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 19:28:15.303987 12236 raft_consensus.cc:482] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 19:28:15.304349 12236 raft_consensus.cc:3037] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.311040 12236 raft_consensus.cc:504] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.310961 12210 raft_consensus.cc:504] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.313856 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed49cf31c9d8459da5bea1d3a07b5fa0" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110"
I20260812 19:28:15.314482 11447 raft_consensus.cc:3037] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.321441 11447 raft_consensus.cc:2454] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 1.
I20260812 19:28:15.322523 11725 leader_election.cc:302] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744, 7ae3a240f89541df8f79c381ff857110; no voters:
I20260812 19:28:15.324452 12218 raft_consensus.cc:2781] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:15.324895 12218 raft_consensus.cc:686] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [term 1 LEADER]: Becoming Leader. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Running, Role: LEADER
I20260812 19:28:15.329259 12218 consensus_queue.cc:237] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } } peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } }
I20260812 19:28:15.337092 12236 leader_election.cc:288] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 election: Requested vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:15.342481 11612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed49cf31c9d8459da5bea1d3a07b5fa0" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
I20260812 19:28:15.343075 11612 raft_consensus.cc:3037] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.350381 11797 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1293c85b89b140c7a9c1c331390ba8f0" candidate_uuid: "7ae3a240f89541df8f79c381ff857110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1cc50828dde64ba6a456762a258fc744"
I20260812 19:28:15.350641 11610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1293c85b89b140c7a9c1c331390ba8f0" candidate_uuid: "7ae3a240f89541df8f79c381ff857110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a"
I20260812 19:28:15.351050 11612 raft_consensus.cc:2454] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1cc50828dde64ba6a456762a258fc744 in term 1.
I20260812 19:28:15.351218 11610 raft_consensus.cc:3037] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 0 FOLLOWER]: Advancing to term 1
W20260812 19:28:15.351956 11373 leader_election.cc:341] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133): Illegal state: must be running to vote when last-logged opid is not known
I20260812 19:28:15.357506 11610 raft_consensus.cc:2454] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ae3a240f89541df8f79c381ff857110 in term 1.
I20260812 19:28:15.359483 11374 leader_election.cc:302] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110; no voters: 1cc50828dde64ba6a456762a258fc744
I20260812 19:28:15.365274 12210 leader_election.cc:288] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [CANDIDATE]: Term 1 election: Requested vote from peers 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:15.366417 12210 raft_consensus.cc:2781] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 19:28:15.367494 12210 raft_consensus.cc:686] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [term 1 LEADER]: Becoming Leader. State: Replica: 7ae3a240f89541df8f79c381ff857110, State: Running, Role: LEADER
I20260812 19:28:15.368526 12207 tablet_bootstrap.cc:492] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744: No bootstrap required, opened a new log
I20260812 19:28:15.369223 12207 ts_tablet_manager.cc:1397] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744: Time spent bootstrapping tablet: real 0.192s user 0.006s sys 0.007s
I20260812 19:28:15.374125 12207 raft_consensus.cc:348] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.374881 12207 raft_consensus.cc:374] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 19:28:15.375159 12207 raft_consensus.cc:729] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc50828dde64ba6a456762a258fc744, State: Initialized, Role: FOLLOWER
I20260812 19:28:15.375859 12207 consensus_queue.cc:260] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.379093 12207 ts_tablet_manager.cc:1428] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744: Time spent starting tablet: real 0.009s user 0.005s sys 0.004s
I20260812 19:28:15.381492 12193 ts_tablet_manager.cc:1918] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
I20260812 19:28:15.390933 12193 log.cc:1196] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting WAL directory at /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/ts-1/wal/wals/c3df30578cb841a290855c251455f3d9
I20260812 19:28:15.391943 12193 ts_tablet_manager.cc:1939] T c3df30578cb841a290855c251455f3d9 P 1d029ad126b9436aa9f4a1c9e1b6b18a: Deleting consensus metadata
I20260812 19:28:15.407339 12210 consensus_queue.cc:237] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
W20260812 19:28:15.440364 11722 connection.cc:535] server connection from 127.0.0.1:49166 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:15.440660 11867 connection.cc:535] client connection to 127.7.144.254:36253 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:15.440943 11722 connection.cc:535] client connection to 127.7.144.254:36253 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:15.442724 11867 master_proxy_rpc.cc:203] Re-attempting AlterTable request to leader Master (127.7.144.254:36253)
W20260812 19:28:15.443883 11867 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.144.254:36253)
W20260812 19:28:15.447577 11372 connection.cc:535] client connection to 127.7.144.254:36253 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:15.448800 11538 connection.cc:535] server connection from 127.0.0.1:34722 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:15.449558 11535 connection.cc:535] client connection to 127.7.144.254:36253 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 19:28:15.453434 12190 negotiation.cc:337] Failed RPC negotiation. Trace:
0812 19:28:15.442652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.7.144.254:36253 (local address 127.7.144.195:36603)
0812 19:28:15.445852 (+ 3200us) negotiation.cc:107] Waiting for socket to connect
0812 19:28:15.445895 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0812 19:28:15.446216 (+ 321us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0812 19:28:15.452219 (+ 6003us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":2766}
W20260812 19:28:15.457122 11867 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.144.254:36253)
W20260812 19:28:15.457759 11867 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.144.254:36253)
I20260812 19:28:15.489123 7747 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu with pid 11923
W20260812 19:28:15.532819 11868 connection.cc:535] client connection to 127.7.144.252:41467 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 19:28:15.864656 12218 raft_consensus.cc:482] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:15.865221 12218 raft_consensus.cc:504] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 } } peers { permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 } } peers { permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 } }
I20260812 19:28:15.867432 12218 leader_election.cc:288] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739), 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:15.868779 11610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1293c85b89b140c7a9c1c331390ba8f0" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" is_pre_election: true
I20260812 19:28:15.869040 11447 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1293c85b89b140c7a9c1c331390ba8f0" candidate_uuid: "1cc50828dde64ba6a456762a258fc744" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ae3a240f89541df8f79c381ff857110" is_pre_election: true
I20260812 19:28:15.869575 11610 raft_consensus.cc:2379] T 1293c85b89b140c7a9c1c331390ba8f0 P 1d029ad126b9436aa9f4a1c9e1b6b18a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1cc50828dde64ba6a456762a258fc744 in current term 1: Already voted for candidate 7ae3a240f89541df8f79c381ff857110 in this term.
I20260812 19:28:15.870760 11725 leader_election.cc:302] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1cc50828dde64ba6a456762a258fc744; no voters: 1d029ad126b9436aa9f4a1c9e1b6b18a, 7ae3a240f89541df8f79c381ff857110
I20260812 19:28:15.871557 12218 raft_consensus.cc:3037] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [term 0 FOLLOWER]: Advancing to term 1
I20260812 19:28:15.879081 12218 raft_consensus.cc:2726] T 1293c85b89b140c7a9c1c331390ba8f0 P 1cc50828dde64ba6a456762a258fc744 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260812 19:28:16.052142 12218 consensus_queue.cc:1035] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260812 19:28:16.103225 12218 consensus_queue.cc:1035] T ce082dbdf29448099415b571866db633 P 1cc50828dde64ba6a456762a258fc744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:28:16.152456 7747 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
/tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:41467
--webserver_interface=127.7.144.252
--webserver_port=46487
--builtin_ntp_servers=127.7.144.212:33355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--hive_metastore_uris=thrift://127.0.0.1:36931
--hive_metastore_notification_log_poll_period_seconds=1
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--catalog_manager_bg_task_wait_ms=10
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--leader_failure_max_missed_heartbeat_periods=1.0
--log_preallocate_segments=false with env {}
I20260812 19:28:16.230971 12218 consensus_queue.cc:1035] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:28:16.249779 12218 consensus_queue.cc:1035] T ed49cf31c9d8459da5bea1d3a07b5fa0 P 1cc50828dde64ba6a456762a258fc744 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ae3a240f89541df8f79c381ff857110" member_type: VOTER last_known_addr { host: "127.7.144.193" port: 41739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:28:16.285661 12258 consensus_queue.cc:1035] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1cc50828dde64ba6a456762a258fc744" member_type: VOTER last_known_addr { host: "127.7.144.195" port: 43133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 19:28:16.308317 12258 consensus_queue.cc:1035] T 1293c85b89b140c7a9c1c331390ba8f0 P 7ae3a240f89541df8f79c381ff857110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" member_type: VOTER last_known_addr { host: "127.7.144.194" port: 41189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260812 19:28:16.578554 12264 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 19:28:16.579174 12264 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 19:28:16.579646 12264 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260812 19:28:16.613822 12264 flags.cc:425] Enabled experimental flag: --enable_metadata_cleanup_for_deleted_tables_and_tablets=true
W20260812 19:28:16.614157 12264 flags.cc:425] Enabled experimental flag: --metadata_for_deleted_table_and_tablet_reserved_secs=0
W20260812 19:28:16.614535 12264 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 19:28:16.614885 12264 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260812 19:28:16.615155 12264 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 19:28:16.615399 12264 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260812 19:28:16.653981 12264 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.7.144.212:33355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--log_preallocate_segments=false
--leader_failure_max_missed_heartbeat_periods=1
--fs_data_dirs=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
--hive_metastore_uris=thrift://127.0.0.1:36931
--catalog_manager_bg_task_wait_ms=10
--enable_metadata_cleanup_for_deleted_tables_and_tablets=true
--metadata_for_deleted_table_and_tablet_reserved_secs=0
--hive_metastore_notification_log_poll_period_seconds=1
--ipki_ca_key_size=768
--master_addresses=127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.7.144.252:41467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.7.144.252
--webserver_port=46487
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 12 Aug 2026 18:20:25 UTC on ccycloud.quasar-plgbua.root.comops.site
build id 4583012
TSAN enabled
I20260812 19:28:16.655366 12264 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 19:28:16.657063 12264 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260812 19:28:16.681655 12281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:28:16.683614 12280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:28:16.681726 12283 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 19:28:18.146327 12282 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1463 milliseconds
I20260812 19:28:18.146452 12264 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260812 19:28:18.147787 12264 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 19:28:18.150782 12264 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 19:28:18.152199 12264 hybrid_clock.cc:648] HybridClock initialized: now 1786562898152145 us; error 60 us; skew 500 ppm
I20260812 19:28:18.155990 12264 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260812 19:28:18.171767 12264 webserver.cc:460] Webserver started at http://127.7.144.252:46487/ using document root <none> and password file <none>
I20260812 19:28:18.173092 12264 fs_manager.cc:359] Metadata directory not provided
I20260812 19:28:18.173388 12264 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 19:28:18.184414 12264 fs_manager.cc:709] Time spent opening directory manager: real 0.007s user 0.007s sys 0.001s
I20260812 19:28:18.190286 12312 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260812 19:28:18.191537 12264 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260812 19:28:18.191905 12264 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data,/tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
uuid: "f056fc7d059f449da00729dc497e4da3"
format_stamp: "Formatted at 2026-08-12 19:27:59 on dist-test-slave-0b58"
I20260812 19:28:18.194377 12264 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 19:28:18.256510 12264 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260812 19:28:18.258121 12264 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 19:28:18.258658 12264 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 19:28:18.338539 12264 rpc_server.cc:307] RPC server started. Bound to: 127.7.144.252:41467
I20260812 19:28:18.338671 12368 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.144.252:41467 every 8 connection(s)
I20260812 19:28:18.342824 12264 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskmh1KKU/test-tmp/master-stress-test.0.CatalogManagerConfigurations_MasterStressTest.Test_3.1786562791343942-7747-0/minicluster-data/master-2/data/info.pb
I20260812 19:28:18.343796 7747 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskmh1KKU/build/tsan/bin/kudu as pid 12264
I20260812 19:28:18.356057 12370 sys_catalog.cc:263] Verifying existing consensus state
I20260812 19:28:18.374874 12370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Bootstrap starting.
I20260812 19:28:18.381665 11668 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:18.397549 11853 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:18.411814 12370 log.cc:824] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Log is configured to *not* fsync() on all Append() calls
I20260812 19:28:18.417220 11497 heartbeater.cc:347] Connected to a master server at 127.7.144.252:41467
I20260812 19:28:18.507647 12370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Bootstrap replayed 1/1 log segments. Stats: ops{read=40 overwritten=0 applied=40 ignored=0} inserts{seen=20 ignored=0} mutations{seen=38 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 19:28:18.508539 12370 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: Bootstrap complete.
I20260812 19:28:18.526551 12370 raft_consensus.cc:348] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:18.528788 12370 raft_consensus.cc:729] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: f056fc7d059f449da00729dc497e4da3, State: Initialized, Role: FOLLOWER
I20260812 19:28:18.529604 12370 consensus_queue.cc:260] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 40, Last appended: 7.40, Last appended by leader: 40, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:18.531883 12384 sys_catalog.cc:455] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } } }
I20260812 19:28:18.532578 12384 sys_catalog.cc:458] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: This master's current role is: FOLLOWER
I20260812 19:28:18.533059 12370 sys_catalog.cc:564] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 19:28:18.557226 12401 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260812 19:28:18.579144 12401 catalog_manager.cc:1259] Loaded cluster ID: 399a2818291549c9b7c1b5cdb4c0df3d
I20260812 19:28:18.579457 12401 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: loading cluster ID for follower catalog manager: success
I20260812 19:28:18.562711 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:18.585868 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:18.589547 12401 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: acquiring CA information for follower catalog manager: success
I20260812 19:28:18.597548 12401 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260812 19:28:18.896477 12328 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "1d029ad126b9436aa9f4a1c9e1b6b18a" instance_seqno: 1786562885991415) as {username='slave'} at 127.7.144.194:45121; Asking this server to re-register.
I20260812 19:28:18.898315 11668 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:18.902602 12328 ts_manager.cc:194] Registered new tserver with Master: 1d029ad126b9436aa9f4a1c9e1b6b18a (127.7.144.194:41189)
I20260812 19:28:18.907739 12328 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "1cc50828dde64ba6a456762a258fc744" instance_seqno: 1786562888060686) as {username='slave'} at 127.7.144.195:59369; Asking this server to re-register.
I20260812 19:28:18.909008 11853 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:18.912207 12328 ts_manager.cc:194] Registered new tserver with Master: 1cc50828dde64ba6a456762a258fc744 (127.7.144.195:43133)
I20260812 19:28:18.925422 12328 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "7ae3a240f89541df8f79c381ff857110" instance_seqno: 1786562883762261) as {username='slave'} at 127.7.144.193:33079; Asking this server to re-register.
I20260812 19:28:18.926764 11497 heartbeater.cc:464] Registering TS with master...
I20260812 19:28:18.930039 12328 ts_manager.cc:194] Registered new tserver with Master: 7ae3a240f89541df8f79c381ff857110 (127.7.144.193:41739)
I20260812 19:28:18.930998 12384 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:18.931432 12384 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:18.933836 12384 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:18.937502 12315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:28:18.944720 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:28:18.946874 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:28:18.947333 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:18.948310 12384 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:19.482654 12411 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:19.483152 12411 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:19.485548 12411 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:19.496819 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:28:19.497308 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:19.497661 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:19.498246 12411 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:20.453081 12422 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:20.453497 12422 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:20.454947 12422 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:20.459896 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:28:20.460428 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:20.460892 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:20.461674 12422 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:20.658241 7747 master-stress-test.cc:578] Killing test thread 1/10
I20260812 19:28:21.950882 12436 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:21.951599 12436 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:21.953698 12436 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:21.958276 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:28:21.958750 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:21.959100 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:21.959633 12436 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:28:23.362107 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000de380 after lost signal to thread 11692
W20260812 19:28:23.363003 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000b41e0 after lost signal to thread 11851
I20260812 19:28:23.570308 12461 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:23.570804 12461 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:23.572454 12461 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:23.577066 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:28:23.578292 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:23.578680 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:23.579784 12461 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:23.588013 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:23.588481 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:27.282424 12507 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:27.283087 12507 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:27.285205 12507 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:27.287472 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 9 similar messages]
W20260812 19:28:27.291287 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:28:27.291857 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:27.292184 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:27.292913 12507 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:28.591503 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:28.592008 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:28:29.181160 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000e23e0 after lost signal to thread 11507
W20260812 19:28:29.182207 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000dfea0 after lost signal to thread 11666
I20260812 19:28:31.353936 12554 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:31.354387 12554 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:31.356158 12554 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:31.361069 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:28:31.361477 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:28:31.361855 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:31.362468 12554 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:33.053452 12581 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:33.053864 12581 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:33.055540 12581 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:33.057907 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:28:33.060609 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:28:33.061038 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:28:33.061378 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:33.061955 12581 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:33.595434 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:33.595813 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:38.599262 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:38.599715 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:43.236775 12701 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:28:43.237270 12701 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:28:43.239032 12701 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:28:43.241672 12315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:28:43.245172 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:28:43.245719 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:28:43.246068 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:28:43.246755 12701 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:28:43.601917 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:43.602361 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:48.606169 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:48.606638 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:53.609732 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:53.610170 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:28:58.613713 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:28:58.614303 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:01.189963 12910 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:29:01.190577 12910 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
W20260812 19:29:01.195309 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
I20260812 19:29:01.197340 12910 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:29:01.199441 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:29:01.200024 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:29:01.200384 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:29:01.201014 12910 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:29:03.617072 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:03.617447 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:08.620759 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:08.621181 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:29:08.779856 11500 heartbeater.cc:644] Failed to heartbeat to 127.7.144.254:36253 (113 consecutive failures): Network error: Failed to ping master at 127.7.144.254:36253: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:29:09.083454 11667 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (133 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:29:09.229005 11852 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (135 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:29:11.138137 12365 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0400 after lost signal to thread 12274
W20260812 19:29:11.138731 12365 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5240 after lost signal to thread 12368
I20260812 19:29:12.006701 13039 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:29:12.007397 13039 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:29:12.009613 13039 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:29:12.012406 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:29:12.016466 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:29:12.017203 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:29:12.017534 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:29:12.018180 13039 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:29:13.658900 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:13.659278 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:29:15.590423 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000408c0 after lost signal to thread 11345
W20260812 19:29:15.591392 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000da4e0 after lost signal to thread 11495
W20260812 19:29:17.214578 11492 debug-util.cc:398] Leaking SignalData structure 0x7b080006f060 after lost signal to thread 11345
W20260812 19:29:17.215580 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000c60e0 after lost signal to thread 11495
I20260812 19:29:18.662484 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:18.662972 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:29:23.396036 12365 debug-util.cc:398] Leaking SignalData structure 0x7b080007b840 after lost signal to thread 12274
W20260812 19:29:23.396586 12365 debug-util.cc:398] Leaking SignalData structure 0x7b080009e800 after lost signal to thread 12368
I20260812 19:29:23.692445 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:23.692838 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:27.920985 13288 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:29:27.921484 13288 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:29:27.924031 13288 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:29:27.926540 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:29:27.929734 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:29:27.930203 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:29:27.930513 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:29:27.931049 13288 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:29:28.695789 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:28.696236 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:33.699071 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:33.699441 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:29:34.675909 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000da6e0 after lost signal to thread 11507
W20260812 19:29:34.677531 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000413e0 after lost signal to thread 11666
I20260812 19:29:37.199885 13444 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:29:37.200543 13444 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:29:37.202574 13444 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:29:37.205278 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:29:37.209204 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:29:37.209690 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:29:37.210040 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:29:37.210721 13444 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:29:38.702433 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:38.702888 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:43.705616 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:43.706032 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:48.709451 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:48.710001 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:52.079051 13697 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:29:52.079584 13697 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:29:52.081614 13697 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:29:52.083592 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:29:52.086484 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:29:52.086906 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:29:52.087198 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:29:52.087700 13697 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:29:53.712697 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:53.713063 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:29:57.662846 13797 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:29:57.663363 13797 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:29:57.665266 13797 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:29:57.667552 12315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:29:57.670285 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:29:57.670732 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:29:57.671064 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:29:57.671617 13797 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:29:58.234390 13811 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:29:58.234927 13811 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:29:58.236902 13811 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:29:58.242506 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:29:58.243034 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:29:58.243323 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:29:58.243939 13811 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:29:58.715227 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:29:58.715742 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:03.718255 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:03.718677 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:05.272161 13941 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:05.272614 13941 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:05.274128 13941 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:05.275969 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:30:05.278908 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:05.279251 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:30:05.279551 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:05.280043 13941 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:30:05.934991 13952 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:05.935425 13952 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:05.937146 13952 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:05.941236 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:05.941581 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:30:05.941900 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:05.942389 13952 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:30:08.722541 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:08.723131 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:30:09.174423 11496 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (254 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:30:09.482858 11670 heartbeater.cc:644] Failed to heartbeat to 127.7.144.254:36253 (233 consecutive failures): Network error: Failed to ping master at 127.7.144.254:36253: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:09.615186 11852 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (255 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:30:09.811784 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000e58e0 after lost signal to thread 11692
W20260812 19:30:09.812693 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000df0a0 after lost signal to thread 11851
I20260812 19:30:13.726212 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:13.726627 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:30:14.651904 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5860 after lost signal to thread 11345
W20260812 19:30:14.652839 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000c1560 after lost signal to thread 11495
I20260812 19:30:17.349845 14145 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:17.350414 14145 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:17.352167 14145 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:17.354786 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:30:17.358283 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:30:17.358788 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:30:17.359086 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:17.359658 14145 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:30:18.569670 12318 maintenance_manager.cc:419] P f056fc7d059f449da00729dc497e4da3: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033344
I20260812 19:30:18.646083 12317 maintenance_manager.cc:643] P f056fc7d059f449da00729dc497e4da3: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.075s user 0.048s sys 0.013s Metrics: {"bytes_written":11784,"cfile_init":1,"drs_written":1,"lbm_read_time_us":274,"lbm_reads_lt_1ms":4,"lbm_write_time_us":2571,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"rows_written":20,"thread_start_us":466,"threads_started":1,"wal-append.queue_time_us":830}
I20260812 19:30:18.648197 12318 maintenance_manager.cc:419] P f056fc7d059f449da00729dc497e4da3: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 1158 bytes on disk
I20260812 19:30:18.649748 12317 maintenance_manager.cc:643] P f056fc7d059f449da00729dc497e4da3: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":209,"lbm_reads_lt_1ms":4}
I20260812 19:30:18.731037 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:18.731539 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:23.734513 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:23.734925 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:28.738654 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:28.739184 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:33.742489 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:33.742877 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:34.016913 14427 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:34.017470 14427 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:34.020108 14427 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:34.022804 12315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:30:34.025962 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:34.026372 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:30:34.026644 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:34.027181 14427 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:30:36.020953 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2020 after lost signal to thread 11345
W20260812 19:30:36.021874 11492 debug-util.cc:398] Leaking SignalData structure 0x7b0800042be0 after lost signal to thread 11495
I20260812 19:30:38.746407 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:38.747020 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:40.245704 14553 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:40.246181 14553 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:40.247931 14553 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:40.250389 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:30:40.253589 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:40.254163 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:30:40.254479 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:40.255095 14553 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:30:41.839661 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4ca0 after lost signal to thread 11692
W20260812 19:30:41.840605 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3fc0 after lost signal to thread 11851
I20260812 19:30:43.750164 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:43.750615 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:45.684978 14651 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:45.685521 14651 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:45.687074 14651 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:45.689206 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:30:45.692126 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:45.692555 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:30:45.692875 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:45.693398 14651 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:30:46.890748 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000d11c0 after lost signal to thread 11692
W20260812 19:30:46.893412 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000e0e60 after lost signal to thread 11851
I20260812 19:30:47.246297 14684 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:47.246915 14684 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:47.248831 14684 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:47.254174 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:47.254786 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:30:47.255049 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:47.255638 14684 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:30:47.408926 12365 debug-util.cc:398] Leaking SignalData structure 0x7b08000b1120 after lost signal to thread 12274
W20260812 19:30:47.409783 12365 debug-util.cc:398] Leaking SignalData structure 0x7b08000506a0 after lost signal to thread 12368
I20260812 19:30:48.773767 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:48.774179 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:53.777313 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:53.777863 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:30:56.510812 14881 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:30:56.511257 14881 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:30:56.513036 14881 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:30:56.514796 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:30:56.517831 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:30:56.518290 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:30:56.518615 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:30:56.519145 14881 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:30:58.781358 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:30:58.781847 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:03.784590 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:03.784991 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:05.966884 15090 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:05.967340 15090 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:05.969069 15090 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:05.971395 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:31:05.974438 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:31:05.974982 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:31:05.975250 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:05.975870 15090 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:31:08.788762 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:08.789217 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:31:09.553053 11496 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (374 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:31:09.870438 11667 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (373 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:31:10.036311 11858 heartbeater.cc:644] Failed to heartbeat to 127.7.144.254:36253 (353 consecutive failures): Network error: Failed to ping master at 127.7.144.254:36253: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:31:13.823264 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:13.823691 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:31:14.760897 12365 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2340 after lost signal to thread 12274
W20260812 19:31:14.761621 12365 debug-util.cc:398] Leaking SignalData structure 0x7b08000509a0 after lost signal to thread 12368
W20260812 19:31:18.304620 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000cc900 after lost signal to thread 11507
W20260812 19:31:18.305537 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000c11c0 after lost signal to thread 11666
I20260812 19:31:18.449360 15365 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:18.449841 15365 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:18.451506 15365 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:18.454030 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:31:18.457113 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:31:18.457561 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:31:18.457861 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:18.458431 15365 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:31:18.826048 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:18.826543 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:20.459139 15416 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:20.459542 15416 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:20.461122 15416 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:20.465392 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:31:20.465807 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:31:20.466111 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:20.466606 15416 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:31:23.829586 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:23.829968 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:28.833552 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:28.833989 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:32.342878 15656 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:32.343324 15656 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:32.344944 15656 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:32.347015 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:31:32.350546 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:31:32.351277 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:31:32.351553 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:32.352092 15656 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:31:33.836666 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:33.837033 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:34.748063 15702 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:34.748520 15702 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:34.750231 15702 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:34.755297 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:31:34.755816 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:31:34.756287 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:34.756883 15702 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:31:38.840781 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:38.841315 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:39.210860 15790 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:39.211385 15790 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:39.213295 15790 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:39.214603 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:31:39.217839 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:31:39.218500 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:31:39.218868 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:39.219509 15790 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260812 19:31:41.833578 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0bc0 after lost signal to thread 11692
W20260812 19:31:41.834586 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000bfcc0 after lost signal to thread 11851
I20260812 19:31:43.309861 15874 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:43.310322 15874 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:43.312347 15874 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:43.317236 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:31:43.317811 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:31:43.318200 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:43.318811 15874 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:31:43.844071 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:43.844559 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:31:44.733866 11848 debug-util.cc:398] Leaking SignalData structure 0x7b0800042300 after lost signal to thread 11692
W20260812 19:31:44.734865 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8040 after lost signal to thread 11851
I20260812 19:31:48.847980 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:48.848584 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:52.082602 16059 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:31:52.083089 16059 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:31:52.084854 16059 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:31:52.087332 12315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:31:52.090466 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:31:52.090893 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:31:52.091169 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:31:52.091832 16059 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:31:53.851374 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:53.851792 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:31:58.857147 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:31:58.857709 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:32:03.860795 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:03.861356 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:32:08.522132 16419 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:08.522734 16419 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:08.525225 16419 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:08.527880 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:32:08.530788 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:32:08.531206 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:32:08.531533 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:08.532140 16419 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:08.863822 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:08.864423 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:32:09.048236 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000423a0 after lost signal to thread 11345
W20260812 19:32:09.049232 11492 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5060 after lost signal to thread 11495
W20260812 19:32:09.948662 11500 heartbeater.cc:644] Failed to heartbeat to 127.7.144.254:36253 (473 consecutive failures): Network error: Failed to ping master at 127.7.144.254:36253: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:32:10.278254 11667 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (493 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:32:10.431866 11852 heartbeater.cc:644] Failed to heartbeat to 127.7.144.253:33833 (495 consecutive failures): Network error: Failed to ping master at 127.7.144.253:33833: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:32:13.744117 16522 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:13.744845 16522 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:13.747285 16522 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:13.749361 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:32:13.753023 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:32:13.754017 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:32:13.754421 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:13.755151 16522 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:13.866710 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:13.867125 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:32:15.864913 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000d53e0 after lost signal to thread 11692
W20260812 19:32:15.865926 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000b33c0 after lost signal to thread 11851
I20260812 19:32:18.870709 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:18.871253 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:32:23.874583 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:23.874976 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:32:24.784902 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000c61e0 after lost signal to thread 11507
W20260812 19:32:24.785805 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8400 after lost signal to thread 11666
I20260812 19:32:28.878693 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:28.879277 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:32:30.652977 16831 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:30.653515 16831 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:30.655555 16831 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:30.657481 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 1 similar messages]
W20260812 19:32:30.660507 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:32:30.660933 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:32:30.661252 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:30.661790 16831 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:32.572978 16874 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:32.573462 16874 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:32.575044 16874 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:32.579761 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:32:32.580358 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:32:32.580653 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:32.581282 16874 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:33.882642 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:33.883136 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:32:34.792137 16921 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:34.792629 16921 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:34.794390 16921 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:34.813979 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:32:34.814654 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:32:34.814991 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:34.815570 16921 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:36.734298 16968 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:36.734835 16968 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:36.736626 16968 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:36.738360 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260812 19:32:36.741882 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:32:36.742508 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:32:36.742774 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:36.743391 16968 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:38.887405 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:38.887934 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:32:39.366643 17030 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:39.367172 17030 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:39.369305 17030 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:39.373282 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:32:39.373796 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:32:39.374125 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:39.374691 17030 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:43.891069 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:43.891587 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:32:48.895426 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:48.896001 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:32:52.128059 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000bc700 after lost signal to thread 11507
W20260812 19:32:52.128993 11663 debug-util.cc:398] Leaking SignalData structure 0x7b08000d07e0 after lost signal to thread 11666
I20260812 19:32:53.898754 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:53.899152 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:32:58.257318 12365 debug-util.cc:398] Leaking SignalData structure 0x7b08000a1b20 after lost signal to thread 12274
W20260812 19:32:58.257967 12365 debug-util.cc:398] Leaking SignalData structure 0x7b080004f080 after lost signal to thread 12368
I20260812 19:32:58.310307 17395 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:32:58.311029 17395 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:32:58.314508 17395 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:32:58.316757 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260812 19:32:58.316792 12315 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:32:58.319226 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:32:58.319645 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
I20260812 19:32:58.319952 12315 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:32:58.320588 17395 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:32:58.932298 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:32:58.932704 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260812 19:33:03.935379 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:33:03.935762 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:33:07.981168 11848 debug-util.cc:398] Leaking SignalData structure 0x7b08000d8e80 after lost signal to thread 11692
W20260812 19:33:07.982627 11848 debug-util.cc:398] Leaking SignalData structure 0x7b080003fac0 after lost signal to thread 11851
I20260812 19:33:08.307844 17604 raft_consensus.cc:482] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 19:33:08.308466 17604 raft_consensus.cc:504] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2b825f98e3684b83869afc840fa6e68a" member_type: VOTER last_known_addr { host: "127.7.144.254" port: 36253 } } peers { permanent_uuid: "c0ebc7fa78c6461fb1baa698aaf99ee4" member_type: VOTER last_known_addr { host: "127.7.144.253" port: 33833 } } peers { permanent_uuid: "f056fc7d059f449da00729dc497e4da3" member_type: VOTER last_known_addr { host: "127.7.144.252" port: 41467 } }
I20260812 19:33:08.310830 17604 leader_election.cc:288] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253), c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833)
W20260812 19:33:08.313113 12313 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:33:08.315933 12315 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c0ebc7fa78c6461fb1baa698aaf99ee4 (127.7.144.253:33833): Network error: Client connection negotiation failed: client connection to 127.7.144.253:33833: connect: Connection refused (error 111)
W20260812 19:33:08.316414 12313 leader_election.cc:334] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 2b825f98e3684b83869afc840fa6e68a (127.7.144.254:36253): Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
I20260812 19:33:08.316722 12313 leader_election.cc:302] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f056fc7d059f449da00729dc497e4da3; no voters: 2b825f98e3684b83869afc840fa6e68a, c0ebc7fa78c6461fb1baa698aaf99ee4
I20260812 19:33:08.317911 17604 raft_consensus.cc:2726] T 00000000000000000000000000000000 P f056fc7d059f449da00729dc497e4da3 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 19:33:08.938592 12264 master_runner.cc:186] Error getting master registration for 127.7.144.254:36253: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111),
I20260812 19:33:08.939021 12264 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260812 19:33:09.186486 11867 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:33:09.187167 11867 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:33:09.187551 11867 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
W20260812 19:33:09.187870 11867 master_proxy_rpc.cc:177] Failed to determine new leader Master: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
F20260812 19:33:09.200515 11881 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
*** Check failure stack trace: ***
F20260812 19:33:09.202143 11880 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
*** Check failure stack trace: ***
W20260812 19:33:09.207958 11867 master_proxy_rpc.cc:203] Re-attempting ReplaceTablet request to leader Master (127.7.144.254:36253)
*** Aborted at 1786563189 (unix time) try "date -d @1786563189" if you are using GNU date ***
W20260812 19:33:09.211252 11867 master_proxy_rpc.cc:203] Re-attempting DeleteTable request to leader Master (127.7.144.254:36253)
W20260812 19:33:09.214972 11867 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.7.144.254:36253)
F20260812 19:33:09.202143 11880 master-stress-test.cc:329] Check failed: _s.ok() Bad status: Timed out: AlterTable timed out after deadline expired: AlterTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)F20260812 19:33:09.221572 11879 master-stress-test.cc:298] Check failed: _s.ok() Bad status: Timed out: Error creating table default.Table_05da0fc81466451091ddbe2cb3550364 on the master: CreateTable timed out after deadline expired: CreateTable passed its deadline: Timed out: ConnectToClusterRpc(addrs: 127.7.144.254:36253,127.7.144.253:33833,127.7.144.252:41467, num_attempts: 760) passed its deadline: Network error: Client connection negotiation failed: client connection to 127.7.144.254:36253: connect: Connection refused (error 111)
*** Check failure stack trace: ***
PC: @ 0x0 (unknown)
*** SIGABRT (@0x3e800001e43) received by PID 7747 (TID 0x7fb8fe9f9700) from PID 7747; stack trace: ***
@ 0x2b0af0 __tsan::CallUserSignalHandler() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1915
@ 0x2b31e0 rtl_sigaction() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:2005
@ 0x7fb911502980 (unknown) at ??:0
@ 0x7fb90c7bfe87 gsignal at ??:0
@ 0x7fb90c7c17f1 abort at ??:0
@ 0x2b4f37 __interceptor_abort at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:263
==================
WARNING: ThreadSanitizer: data race (pid=7747)
Atomic write of size 8 at 0x7fb90fa1f8c8 by thread T30:
#0 __tsan_atomic64_compare_exchange_val /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interface_atomic.cpp:850:3 (master-stress-test+0x306703)
#1 unsigned long* google::glog_internal_namespace_::sync_val_compare_and_swap<unsigned long*>(unsigned long**, unsigned long*, unsigned long*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/utilities.h:172:10 (libglog.so.1+0x2b2d5)
#2 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/signalhandler.cc:296:7 (libglog.so.1+0x2b2d5)
#3 __tsan::CallUserSignalHandler(__tsan::ThreadState*, bool, bool, bool, int, __sanitizer::__sanitizer_siginfo*, void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1911:45 (master-stress-test+0x2b0aef)
#4 google::LogMessage::Fail() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:1946:3 (libglog.so.1+0x18df3)
#5 google::LogMessage::SendToLog() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:1920:5 (libglog.so.1+0x18df3)
#6 google::LogMessage::Flush() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:1777:5 (libglog.so.1+0x1999f)
#7 google::LogMessageFatal::~LogMessageFatal() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:2557:5 (libglog.so.1+0x1eada)
#8 kudu::MasterStressTest::CreateTableThread() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc (master-stress-test+0x3572c3)
#9 decltype(*(std::__1::forward<kudu::MasterStressTest_Test_Test*>(fp0)).*fp()) std::__1::__invoke<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*, void>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/type_traits:3840:1 (master-stress-test+0x3874cd)
#10 void std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*, 2ul>(std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>&, std::__1::__tuple_indices<2ul>) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:280:5 (master-stress-test+0x387380)
#11 void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*> >(void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:291:5 (master-stress-test+0x386aca)
Previous read of size 8 at 0x7fb90fa1f8c8 by thread T31:
#0 google::(anonymous namespace)::FailureSignalHandler(int, siginfo_t*, void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/signalhandler.cc:302:38 (libglog.so.1+0x2cae0)
#1 __tsan::CallUserSignalHandler(__tsan::ThreadState*, bool, bool, bool, int, __sanitizer::__sanitizer_siginfo*, void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1911:45 (master-stress-test+0x2b0aef)
#2 google::LogMessage::Fail() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:1946:3 (libglog.so.1+0x18df3)
#3 google::LogMessage::SendToLog() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:1920:5 (libglog.so.1+0x18df3)
#4 google::LogMessage::Flush() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:1777:5 (libglog.so.1+0x1999f)
#5 google::LogMessageFatal::~LogMessageFatal() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/logging.cc:2557:5 (libglog.so.1+0x1eada)
#6 kudu::MasterStressTest::AlterTableThread() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:329:7 (master-stress-test+0x3578b5)
#7 decltype(*(std::__1::forward<kudu::MasterStressTest_Test_Test*>(fp0)).*fp()) std::__1::__invoke<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*, void>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/type_traits:3840:1 (master-stress-test+0x3874cd)
#8 void std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*, 2ul>(std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>&, std::__1::__tuple_indices<2ul>) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:280:5 (master-stress-test+0x387380)
#9 void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*> >(void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:291:5 (master-stress-test+0x386aca)
Location is global 'google::(anonymous namespace)::g_entered_thread_id_pointer' of size 8 at 0x7fb90fa1f8c8 (libglog.so.1+0x0000002448c8)
Thread T30 (tid=11879, running) created by main thread at:
#0 pthread_create /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966:3 (master-stress-test+0x2b4412)
#1 std::__1::__libcpp_thread_create(unsigned long*, void* (*)(void*), void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/__threading_support:504:10 (master-stress-test+0x386a5b)
#2 std::__1::thread::thread<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*, void>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:307:16 (master-stress-test+0x3867b7)
#3 void std::__1::allocator<std::__1::thread>::construct<std::__1::thread, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(std::__1::thread*, void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1809:31 (master-stress-test+0x3866bc)
#4 void std::__1::allocator_traits<std::__1::allocator<std::__1::thread> >::__construct<std::__1::thread, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(std::__1::integral_constant<bool, true>, std::__1::allocator<std::__1::thread>&, std::__1::thread*, void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1687:21 (master-stress-test+0x386653)
#5 void std::__1::allocator_traits<std::__1::allocator<std::__1::thread> >::construct<std::__1::thread, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(std::__1::allocator<std::__1::thread>&, std::__1::thread*, void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1538:14 (master-stress-test+0x386593)
#6 void std::__1::vector<std::__1::thread, std::__1::allocator<std::__1::thread> >::__construct_one_at_end<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/vector:926:5 (master-stress-test+0x38629e)
#7 std::__1::thread& std::__1::vector<std::__1::thread, std::__1::allocator<std::__1::thread> >::emplace_back<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/vector:1687:9 (master-stress-test+0x356d1a)
#8 kudu::MasterStressTest_Test_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:558:13 (master-stress-test+0x355b96)
#9 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
#10 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
#11 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
#12 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
#13 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
#14 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
#15 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
#16 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
#17 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
#18 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (master-stress-test+0x38989b)
@ 0x7fb90f7f3df4 google::LogMessage::SendToLog() at ??:0
#19 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (master-stress-test+0x38879c)
Thread T31 (tid=11880, running) created by main thread at:
#0 pthread_create /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966:3 (master-stress-test+0x2b4412)
#1 std::__1::__libcpp_thread_create(unsigned long*, void* (*)(void*), void*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/__threading_support:504:10 (master-stress-test+0x386a5b)
#2 std::__1::thread::thread<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*, void>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:307:16 (master-stress-test+0x3867b7)
#3 void std::__1::allocator<std::__1::thread>::construct<std::__1::thread, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(std::__1::thread*, void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1809:31 (master-stress-test+0x3866bc)
#4 void std::__1::allocator_traits<std::__1::allocator<std::__1::thread> >::__construct<std::__1::thread, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(std::__1::integral_constant<bool, true>, std::__1::allocator<std::__1::thread>&, std::__1::thread*, void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1687:21 (master-stress-test+0x386653)
#5 void std::__1::allocator_traits<std::__1::allocator<std::__1::thread> >::construct<std::__1::thread, void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(std::__1::allocator<std::__1::thread>&, std::__1::thread*, void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1538:14 (master-stress-test+0x386593)
#6 void std::__1::vector<std::__1::thread, std::__1::allocator<std::__1::thread> >::__emplace_back_slow_path<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/vector:1670:5 (master-stress-test+0x3863ce)
#7 std::__1::thread& std::__1::vector<std::__1::thread, std::__1::allocator<std::__1::thread> >::emplace_back<void (kudu::MasterStressTest::*)(), kudu::MasterStressTest_Test_Test*>(void (kudu::MasterStressTest::*&&)(), kudu::MasterStressTest_Test_Test*&&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/vector:1690:9 (master-stress-test+0x356d2a)
#8 kudu::MasterStressTest_Test_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:561:13 (master-stress-test+0x355c06)
#9 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
#10 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
#11 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
#12 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
#13 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
#14 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
#15 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
#16 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
#17 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
#18 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (master-stress-test+0x38989b)
#19 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (master-stress-test+0x38879c)
SUMMARY: ThreadSanitizer: data race /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.6.0/src/utilities.h:172:10 in unsigned long* google::glog_internal_namespace_::sync_val_compare_and_swap<unsigned long*>(unsigned long**, unsigned long*, unsigned long*)
==================
@ 0x7fb90f7f49a0 google::LogMessage::Flush() at ??:0
@ 0x7fb90f7f9adb google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x3578b6 kudu::MasterStressTest::AlterTableThread() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/master-stress-test.cc:?
@ 0x3874ce _ZNSt3__18__invokeIMN4kudu16MasterStressTestEFvvEPNS1_26MasterStressTest_Test_TestEJEvEEDTcldsdeclsr3std3__1E7forwardIT0_Efp0_Efp_spclsr3std3__1E7forwardIT1_Efp1_EEEOT_OS7_DpOS8_ at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/type_traits:3840
@ 0x387381 _ZNSt3__116__thread_executeINS_10unique_ptrINS_15__thread_structENS_14default_deleteIS2_EEEEMN4kudu16MasterStressTestEFvvEJPNS6_26MasterStressTest_Test_TestEEJLm2EEEEvRNS_5tupleIJT_T0_DpT1_EEENS_15__tuple_indicesIJXspT2_EEEE at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:281
@ 0x386acb std::__1::__thread_proxy<>() at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/thread:?
@ 0x2b11b0 __tsan_thread_start_func at /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:959
@ 0x7fb9114f76db start_thread at ??:0
@ 0x7fb90c8a261f clone at ??:0